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ABSTRACT 

Over the past 2 decades the usefulness of the 
computer in science and education has been demonstrated by the rapid 
growth of applications. Striking advances have been made in data 
analysis and research through its use; however, in the direct 
application of computers to the instructional process, obstacles 
still exist between promise and fulfillment. This study seeks to 
identify those obstacles that have hindered the development and 
acceptance of computer use in instruction, and to suggest means for 
overcoming them. The Delphi Technique was used to obtain and analyze 
the judgment of educational practitioners, theoreticians, hardware 
and software specialists, and evaluators on (a) major impediments to 
wider use of computers in instruction, and (b) actions that might 
increase acceptance and use of computer-based instructional 
materials. (Author) 
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PREFACE 



Over llic past two decades the usefulness of the computer in science 
and education has been demonstrated by the rapid growth of applications. 
Striking advances have been made in data analysis and research through its 
use; however, in the direct application of computers to the instructional 
process, obstacles still exist between promise and fulfillment. 

This study seeks to identify those obstacles which have hindered the 
development and acceptance of computer use in instruction, and to 
suggest means for overcoming them. The Delphi Technique was used to 
obtain and analyze the judgment of educational practitioners, theoreti- 
cians, hardware and software specialists, and evaluatots on (a) major 
impediments to wider use of computers in instruction, and (b) actions that 
might increase acceptance and use of computer-based instructional 
materials. 

The results of the project are suggestive rather than definitive. They 
do not represent a conclusion by the panel as to what should be done to 
further acceptance; they do indicate likely sources of difficulty and 
promising steps for resolving them which the project participants believed 
should be considered in planning for the future growth of computer use in 
instruction. 

The report is organized so that a summary overview of major points can 
be found in Chapter III and a general interpretation of the findings in 
Chapter V, following the main body of results. 



O 

ERLC 



3 



A CK NO WL EDG MEN TS 



Wc wish to express our special appreciation to NSF personnel, 
especially to Arthur Melmetl, for the help and guidance given us in 
working out details of the study objectives. 

The efforts and cooperation of the project participants, in all phases of 
the study, arc gratefully acknowledged. 

Special thanks are due to Elsa Rosenthal for her assistance in the 
preparation of the manuscript. 



TABLE OF CONTENTS 



Page 

I STATEMENT OF PROBLEM I 

II RESEARCH PLAN 3 

Definition ofCAI 3 

The Participants 3 

Delphi Technique 4 

Questionnaire Sequence 6 

Conference 6 

Organizational Difficulties 7 

Organization of the Report 8 

III A SUMMARY OF RESULTS II 

IV COMPREHENSIVE DISCUSSION OF RESULTS 1 5 

Question One 1 5 

Questions Two and Three 1 7 

A. Production and Distribution of Instructional Materials 18 

New Directions 20 

The Author 20 

Incentives 20 

Market 2 1 

a. The Publisher 21 

b. Hardware and Software Manufacturers 22 

Market Development 23 

Production Models 24 

Royalty and Copyright 24 

Standardization 25 

National Organizations 25 

B, Demonstration 26 

Large-Scale Demonstrations 27 

Quality and Feasibility 28 

Educational Level 28 

Areas for Successful Demonstrations 29 



0 




C. Theory of Instruction 


31 


Learning Theory 


32 


Unique Characteristics of CAI 


32 


Research Use 


34 


Learner Control 


34 


D. Educational System and the Teacher 


35 


School Resistance 


35 


Teacher Involvement 


37 


Teacher Training 


38 


Teacher Control 


38 


Local vs. Professional Development 


38 


Course Objectives 


39 


CMI 


39 


Educational Revision 


39 


Evaluation and Documentation 


40 


E. Cost 


4! 


Nature of Cost Problem 


41 


Cost Effectiveness 


42 


* Inappropriate Accounting Methods 


42 


Cost Factors-CoIIege and Prccollegc 


43 


F. Technical Research and Develooment 


43 


Hardware Systems 


43 


Natural Language Processor 


45 


Programming Languages 


45 


CONCLUSIONS AND RECOMMENDATIONS 


47 


APPENDICES 


53 


Appendix I - The Questionnaires 


53 


Appendix 2 — Responses to Questionnaire 3 


93 


Appendix 3 - Convergence Data 


97 


Appendix 4 - Original Action Plans 


105 


Appendix 5 - Action Statements 


125 



o 

ERIC 



6 



* 



V'-'I*. 



O 

ERIC 






LIST OF TA BLES 



j Page 

Respondent Experience ' 4 

Response to the First Question 16 

Production/Distribution of Instructional Materials 19 
Demonstration 27 

Theory of Instruction 3 1 

Educational System and the Teacher 36 

Cost 41 

Technical Research and Development 44 

Action Statements 48 

Action Plans as Suggested Directions 49 



Table 

I 

2 

3 

4 

5 

6 

7 

8 

9 

10 



7 



Chapter I 



Statement of Problem 



Considerable manpower and extensive fiscal resources have been ex- 
pended in recent years to investigate the value and cost of computer use 
at all levels of the educational process. The National Science Foundation, 
through its Office of Computing Activities, has supported several of these 
investigations, most notably in the areas of computer applications, user 
services, and training. The specific areas of computer applications that 
received substantial attention were (a) use of computers in problem-solving 
situations, (b) model development and simulation, and (c) computer-aided 
and computer-managed instruction. Studies of user services compared and 
evaluated local versus remote processing, batch versus interactive pro- 
cessing, and cost benefits gained from economy of scale versus cost of the 
new generation of mini-computers. Studies in the training area examined 
the impediments to, and costs of. training faculty in computer use, and 
looked at the problems and costs of developing and distributing computer- 
oriented and computer-based curricular material. 

Certain aspects of these investigations arc of particular concern because 
they have been especially troublesome to evaluate. Probably the major 
difficulty has been that, despite evidence of the computer's value for 
instructional uses, the educational community is still reluctant to acccpi it. 
A reflection of this reluctance is that few educators arc developing quality 
course materials to support instructional applications of the computer. In 
addition to this lag in authorship, thcic arc the problems of unexpectedly 
high costs for developing materials and the total absence of mechanisms 
for distributing materials that have been developed. 

Many explanations have been offered to account for these conditions. 
For example, some observers suggest that inadequate incentives for au- 
thors are a major reason so little faculty effort has been spent on develop- 
ing computer-based materials. Others sec the relatively primitive and 
cumbersome “author languages" as contributing to the discouragingly high 
costs of development. Still others view low volume, limited experience in 
packaging and marketing, and the fear of nonrccovcrablc costs as factors 
that account for the missing distribution mechanisms. 

Numerous additional difficulties have been cited as root causes for the 
lack of widespread use of computers in instruction. The present study was 
undertaken to identify the most plausible explanations of this multi- 
faceted problem and to outline strategics for overcoming the difficulties. 

I 



Chapter II 



Research Plan 




The study was designed to be conducted in two phases. The first phase 
was a questionnaire survey that, through the Delphi Technique, gathered 
(a) opinions about the major obstacles to acceptance of computers in 
instruction, and (b) suggestions of actions or plans for overcoming the 
obstacles. The second phase was a conference whose purpose was to bring 
the participants together to discuss aspects of the action plans, such as 
cost, need, and social and technical feasibility, and to express opinions as 
to which plans were most worthwhile to pursue. 

Definition of CAI 

Throughout the study, computer-assisted instruction (CAI) was used as 
a generic term, comprising all aspects of computer use in an instructional 
context. Included within the scope of the term was what some have pre- 
ferred to call computer-based education, and also problem-solving, gaming, 
simulation, etc. This point was noted on the cover page of each question- 
naire. 

The Participants 

Because computer use in education cuts across a number of disciplines, 
the project participants were selected from several areas of specialization, 
including curriculum development, educational research, educational 
administration, law, computer and systems science, computer hardware 
and software, publishing, and communications regulations. Invitations to 
participate were extended to 42 authorities in these areas, 34 of whom 
accepted. Of this group, 30 completed the questionnaire phase, and 20 
attended the conference that closed the data-gathcring sequence. 

The distribution of the 30 participants among the several areas of 
specialization was as follows: 

Curriculum Development: two directors of commercial instructional 
materials companies, a director of a research center specializing in the 
design of instructional materials, and a university researcher concerned 
with the development of authoring techniques and programming lan- 
guages. 

Educational Research: a director of research for an educational research 
institute, three directors of university CAI labs, and two researchers 
specializing in educational evaluation. 
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Educational Administration: a superintendent or a large metropolitan 
school system* an ex-superintendent now president of an educational 
research firm, a foundation president, an administrator of a national 
educational association, and a university administrator. 

Law: a professor of law specializing in copyright infringement and related 
legal issues arising from applications of new technology. 

Computer and Systems Science: a psychologist and a social scientist \vho 
have served as advisers to the government on the integration of tech- 
nology into education, and three computer scientists specializing in 
computer applications in education. 

Computer Hardware and Software: two representatives of large hardware 
manufacturing firms, and two university professors representing major 
computer centers. 

Communications Regulations: a former commissioner of a communi- 
cations agency. 

In the first questionnaire, 12 categories of CAI-related activities were 
presented and respondents were asked to check those areas in which they 
had had experience. To give an idea of the range of participants* back- 
grounds in terms of CAI, the number of respondents checking each cate- 
gory is listed in Table I. 



1 . 

2 . 
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5. 
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8 . 
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12 . 



Table 1 

Respondent Experience 



Category 



Number Who Checked 



Administration of CAI lab 7 

Administration of computer center 6 

Designing of software 17 

Software development 18 

Designing of hardware 9 

Hardware development 1 1 

Recordkeeping function of computer 10 

Design of computer-based curriculum 12 

Structuring of curriculum content 14 

Evaluating computer-based curricula 12 

Training educators in use of computer- 
based materials 13 

Teaching with computer-based materials 14 




Delphi Technique 

The Delphi Technique is a method for the systematic collection of 
expert or informed opinions. The purpose of the procedure is to obtain a 
consensus without bringing the experts together in a face-to-face meeting; 
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this is achieved by having them complete a scries of questionnaires inter- 
spersed with controlled opinion feedback. Not only can the process mean 
a saving in money, but also, and more importantly for this study, the 
mode of controlled interaction encourages independent thought and the 
gradual formation of thoroughly considered opinion. It has, moreover, the 
advantage of providing anonymity to participants. These characteristics 
give the Delphi Technique a distinct advantage over the traditional faculty 
or committee meeting, where direct confrontation in too many instances 
prompts the formulation of hasty and preconceived notions, an inclination 
to close one’s mind to novel ideas, or a tendency to be influenced by the 
loudest or most persuasive speakers, regardless of the substance of their 
argument. 

Questions appropriate for consideration through the Delphi Technique 
arc those on which mature and infonned judgment must be exercised 
rather than those that lend themselves to analytic solutions. For instance, 
the technique is useful in complex situations such as prediction-making 
where conclusions arc necessarily based on intuitive judgment or insight. 
Greatest success with the technique is generally obtained when the con- 
tributed opinions arc based on thorough knowledge and pertinent experi- 
ence, and when participants arc given the opportunity to make their own 
logical structures and to synthesize what they both know and feel into an 
appropriate form. 

In summary, the advantages of the Delphi Technique for this study 
were these: 



(1) The technique assured each participant substantial opportunity to 
contribute his opinions. 

(2) The procedure could take advantage of multiple types of relevant 
information, since it could sample the knowledge and values of 
experts in diverse fields and disciplines. 

(3) The technique allowed a select body of authorities to deal with 
values as well as with facts, with impunity. 

(4) The technique allowed participants to address, systematically, the 
key issues regarding the use of computers in instruction. 

(5) Through the use of successive questionnaires, it was possible to 
arrive at a careful identification, definition, and evaluation of 
basic problems of demonstration, cost, development, and distri- 
bution of computer-based curricular materials. 



The Delphi Technique is generally applied as follows: (a) the parti- 
cipants arc asked to list their opinions on a specific topic, such as scientific 
predictions or recommended activities; (b) the participants arc then asked 
to evaluate the total list by a criterion, such as importance, chance of 
success, etc.; (c) each participant receives the list and a summary of re- 
sponses to the items — if in the minority he is asked to revise his opinions 
or indicate his reasons for remaining in the minority; (d)cach participant 
again receives the list, an updated summary, and the minority opinions in a 
final opportunity to revise his opinions. 
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Questionnaire Sequence 

The initial phase of the study was conducted with three general aims in 
mind. The first was to have the participants briefly outline their views of 
general educational goals and of the use and value of the computer in 
implementing these goals. The second was to identify factors that have 
inhibited widespread use of computers in instruction. The third was to 
produce plans for future action. 

A sequence of three questionnaires was used to achieve these aims. 
Each of the questionnaires focused on the same three major questions: 

(1) In what ways do you believe the use of computers in instruction 
would improve the educational process? 

(2) Why have computers not been more widely used in the instruc- 
tional process? 

(3) What needs to be done to tap more fully the potential contri- 
bution of the computer to the instructional process? 

The Delphi Technique proved effective in producing convergence on 
the major issues involved in these questions. A more detailed description 
of the substance and logic of the questionnaire sequence is given in Chapter 
IV. Copies of the questionnaires are shown in Appendix I. 

Conference 

To conclude the process of gathering and refining data, a conference 
was held. Its purpose was to focus on orientations for action that could 
overcome the obstacles to CAI acceptance delineated in the questionnaire 
sequence. To this end a scries of “mini-Delphi” exercises were devised 
which were to continue the Delphi format of information feedback and 
opinion refinement. Theoretically these were to combine the advantages of 
the Delphi Technique, described above, while providing opportunity also 
for structured “face-to-face” discussions. 

The data on which the conferees were to work were 83 “action state- 
ments.” These were derived from the questionnaire responses and were 
reduced to a single sentence for easy man ipulability. Both the original action 
suggestions and the action statements arc included in Appendices 4 and 
5. The end product of the Conference was to be a rough ranking of the 
items in terms of “worthiness for additional consideration,” with the top 
half or so of the items receiving further detailed evaluation of cost effec- 
tiveness and feasibility in workshops. There were to be several iterations of 
ratings of the top items, culminating in the allocation of a hypothetical 
five-year budget directed toward advancing the growth in value and accep- 
tance of CAI. 

The sequence was to be as follows: 

First Session: The group rates the 83 statements on a 0-3 scale. 

Second Session: The bottom two-thirds of the ranked list arc considered; 

items not voted in are dropped; new suggestions voted in arc added. 
Third Session: Workshop A - rates items on general feasibility; discusses 

future technological developments and breakthroughs that might affect 
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cost and prepares statements on these. Workshop B - rates items on cost 
cllccttvcncss and discusses those where there arc divergent ratings; splits 
into subgroups which define cost parameters of each item, 
fourth Session: Workshop A - discusses, rates, and prepares statements on 
any especially negative features of items in relation to special-purpose 
or stakeholder groups in education (c.g.. handicapped students, 
teachers, vocational trainees). 

Workship B - estimates cost of items using the prepared cost parameters 
as guidelines; discusses and rates any especially positive values of items 
in relation to educational "stakeholder” groups. 

l ift h Session: The material summarized from the workshops is distributed 
and discussed: the conferees individually allocate a limited budget 
among the items, in separate "Research and Development" and "Action 
and Implementation” programs. 

This series of exercises, however, did not work out as planned. In fact, 
the course of the meetings bore little resemblance to the intended progres- 
sion of inputs and evaluations. From the very beginning of the conference, 
the structure was questioned and even adamantly opposed by some of the 
conferees. This was due in part to misunderstanding, in part to the rigidity 
of the planned procedure, and in part to a fundamental problem which 
was symptomatic of organizational difficulties encountered throughout 
tlic study. 

The misunderstanding ensued from a feeling that the planners had made 
some arbitrary assumptions and that the organization was not appropriate. 
Rather than serving as a minimally constraining framework for tlic con- 
ferees to interact within, as was intended, the format appeared to a 
number of conferees to be an interpretation with which they had to agree 
or disagree at the outset. Some participants felt their viewpoints could not 
emerge in such a framework, or be given enough weight. This was true in 
the sense that the planning of tlic conference was oriented much more 
toward gaining a consensus than toward exploring areas of divergence. 

The rigidity of the procedure lay in the fact that it tended to channel 
the conferees — all highly articulate, experienced specialists with very 
definite opinions - into limited, structured interactions. The conferees 
were more inclined to a format of free discussion, and, in the end, unstruc- 
tured interaction formed the major portion of the conference proceedings. 

The third contributing factor to the conference difficulties pertains to 
the whole study, and is discussed below. 

Organizational Difficulties , 

The fundamental problem underlying the conference organization is 
evidenced throughout the report. The area ofCAl acceptance cuts across a 
broad range of technical, economic, and educational issues. This of course 
is what makes the area so difficult to analyze and evaluate. In order to gain 
the general view that was the object of the study, the participants were 
drawn from a number of fields representing this range. This inevitably 
resulted in a fragmentation of expertise which made it difficult throughout 
the study to approach problems with a common orientation. For instance, 
school administrators thought ofCAl in terms of elementary-level drill and 
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practice, university professors thought of. college-level applications, pub- 
lishers thought in terms of marketable forms, etc. It was clear from the 
responses to the first questionnaire that occasionally some groups of partici- 
pants were reacting on totally different planes than other groups. In the 
conference discussion, emphasis was continually shifting hack to the prob- 
lem of gaining a unified perspective that would be satisfactory for the 
majority of conferees. 

The following characteristics of the study stem from this fact: 

a) The Delphi Technique had to be slightly altered. Since interpreta- 
tion of a particular questionnaire item varied widely depending on (lie 
expert's field, it did not seem reasonable to place emphasis on obtaining 
convergence of item ratings. Instead, the orientation was shifted toward 
gaining information on the overall viewpoints of the respondents, partic- 
ularly in the third questionnaire. Of course, the essential feature of the 
Delphi Technique, in feeding back information and receiving reevaluated 
responses, was useful in getting an overall delineation of where the strong 
divergences in viewpoint were, 

b) in terms of the conference, this fragmentation meant that all the 
participants were not looking at the conference design in the same con- 
text. They disagreed with each other as well as with the planners, and, in 
tlic process of articulating their positions, became much more interested in 
the nature of their disagreements than in reaching any consensus of views. 
Interesting discussions emerged, of course, but not in clcai-cut, readily 
summarizablc form. As a result, as some of the conferees themselves sug- 
gested, the authors have opted to work the conference discussion into the 
report in the loose, subjectively stated way described below, 

c) The dominant opinion in a particular area - c.g,, in education - 
may have come from a subgroup of respondents involved in that area, 
because it is only this group which has commented substantively on the 
topic (or, at the conference, discussed it). The other participants, less 
familiar with the area, remained silent and, in effect, tacitly endorsed the 
view, in other words, some of the opinions that are picscntcd as repre- 
sentative of the group were discussed by relatively few of the participants, 
namely, those who had something to say about them. 

d) The overall picture that the report draws is dependent on the distri- 
bution of participants among fields. That is, it is possible that if more 
computer science experts had been included, the report's section on 
‘Technical Research and Development” would have been expanded. 

Organization of the Report 

The bulk of the results arc drawn from the comments made by ques- 
tionnaire respondents and from the transcripts of the conference discus- 
sion, Quantitative data from the questionnaires are described in a few 
instances, as well as summarized in the appendices. However, for the 
reasons already described little emphasis was placed on the specific rating 
values attaclwd to the questionnaire items. Instead, the authors have tried 
to present a picture of impressions that reflects as accurately as possible 
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the agreements, considerations, disputes and inconsistencies that emerged 
from the soft data, and that give the “best fit" to the hard data. 

It was. of course, obvious that particular points of view were endorsed 
much more strongly by the group than others, which is useful information 
even though it derives from subjective evaluation. Consequently, a rough 
index is used in Chapter IV to indicate the degree of agreement surround- 
ing the issues discussed, as follows: 

*** - high degree of consensus; essentially all participants agreed on this 
point 

**• moderate consensus; most participants agreed, without a signifi- 
cant dissenting view emerging 

* - limited consensus: some but not most participants agreed, with- 
out a significant dissenting view emerging 

Except where points of disagreement or pertinent questionnaire data arc 
described, tlic report consists of what we judge to be the dominant view- 
points, written as though by a hypothetical participant whose opinions 
consistently aligned with the general opinion of flic group. 
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Chapter III 



A Summary of Results 
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For the convenience of readers who do not wish to explore the details 
of the questionnaire rounds and the conference, this chapter briefly sum- 
marizes the principal findings. Comprehensive findings then follow in 
Chapter IV, and in Chapter V the authors have added their own analyses 
and a brief discussion of the suggested plans of action. 

The complex factors inhibiting widespread use of computers in instruc- 
tion have three principal dimensions - educational, economic, and tech- 
nical, These three dimensions are reflected in the six categories into which 
opinions were grouped: (a) production and distribution of instructional 
materials, (b) demonstration of the effectiveness of CA1, (c) theory of 
instruction (need for additional psychological and educational research), 
(d) educational system and the teacher, (c) cost, and (0 technical research 
and development. 

Out of the cumulative Delphi process of questionnaires and the final 
conference of participants, the educational dimension - U\, the problems 
related to the availability of adequate materials and the lack of evidence of 
CAI effectiveness - was judged to be the most critical. Almost as critical "& 
the economic dimension, although the solution to the problem of CAI r, 
high costs was thought to probably depend on already existing market 
pressures which arc bringing costs down. The technical dimension, which is 
mainly concerned with creating adequate CAI delivery systems, was judged 
not to be of criticalilhportaixc^tr ' 

In category a r production and distribution of instructional materials - 
die i^espoivdeife singled out obstacles related to lack of faculty interest in. 
dilfu$it>n.of responsibility for, and lack of incentives for the development 
and distribution of computer-based materials. The lack of good, readily 
available computer-based educational materials was the most highly rated 
item in the study. The scarCity^of materials results from a lack of established 
production metjh^s and procedui^s. Tack of professional and economic 
incentives, and^'e vagueness^!' market prospects. Opinion converged 
toward the %11'oWing ^jc^rty view: A market should be established 
with federal ^hacking Ur ‘inccntives/sfnd this market could be expected 
to become self-supporting, especially if new uses — simulation, gaming, 
problem-solving — were developed. Guidelines for standardization, 
flexible royalty and copyright policies, and appropriate production models 
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(particularly team-oriented approaches), are also needed to encourage the 
growth of a strong market for materials. 

In category b (demonstration), the fact that there arc few examples of 
effective CA1 use was judged to he a major problem. Two opposing view- 
points became evident. One held that large-scale demonstrations of educa- 
tional effectiveness arc needed, but not in the context of status-ouo 
education. CAI must improve education, without undue concern for 
economic feasibility - educational revision should be a national goal. The 
opposing opinion was that CAI should be developed just like any other 
instructional medium; i.c., it only needs commercial incentives to improve 
it, though federal support will be necessary initially. Participants agreed 
that the teaching of basic skills, c.g.. linglish and math, would be a good 
initial target in demonstrating successful applications of CAI. Specific uses 
recommended were: remedial programs for the disadvantaged; curriculum 
development within a discipline; courses for community colleges and lower- 
level undergraduates; education for the handicappped; and vocational, 
industrial and military training. 

In category c (theory of instruction), it was agreed that there is a need 
to gain deeper understanding of CAl's unique instructional capabilities. 
The computer's information-processing potential is far from being fully 
utilized in present CAI systems. Aspects of CAI that should be explored in 
this regard are: the need for new production techniques integrrffing'^Ars 
programming, display and documentation requirements; the grcaWrangeof 
roles from information resource to tutor that CAI can assume; inslnjc- 
tional applications of simulation, gaming and process teaching; the 
potential for individualizing learning sequences; and the use of CAI in a 
research mode. In addition, our knowledge of the instructional process in 
general has to be extended and applied to CAI design. This may not 
involve further direct efforts in learning theory research, but rather may 
come from new experimental techniques arising from the research use of 
CAI itself. 

Broad use of CAI will require changing the traditional role of the 
teacher (category </). This may be a major source of educational resistance 
and must be resolved by effective teacher training and by careful planning 
of CAI systems to support a new role for teachers. Unless this new role is 
attractive to teachers, it will not be accepted by them. Additional resis- 
tance may stem from seeing CAI as a job threat, as an attempt to automate 
education, and as another in a scries of technological aids that have failed 
to fulfill initial expectations. However, the majority felt that if CAI can be 
shown to meet concrete needs, teachers will more readily adopt it. To this 
end. demonstrations must be combined with careful, honest and critical 
evaluations that convincingly indicate the effectiveness of CAI applica- 
tions. These evaluations should entail more rigorous cost effectiveness 
analyses, specification of goals, and measurement of instructional effec- 
tiveness. Such evaluations will help provide a basis for systematic improve- 
ment of educational methods. 

The participants agreed that the problem of high costs (category e) is an 
important one. However, it was felt that normal commercial pressures in 
already existing markets will do much more to bring down costs than any 
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extra effort made for educational applications. It is more important at 
present to concentrate on difficulties that arc specifically educational: 
specifying course objectives so that cost effectiveness can be measured, 
and developing appropriate accounting methods. The cost problem will 
probably be worked out first in colleges, which have fewer restrictions in 
allocating funds and reordering priorities, and which arc most likely to 
have access to computer installations. 

Problems of technical research and development (category f) were 
judged to be less important than educational and economic problems in 
inhibiting widespread use of the computer in education. The most signifi- 
cant problems were considered to be the need to improve the reliability of 
hardware and the design of student terminals. There was sharp disagree- 
ment about the necessity of improving the computer's ability to accept 
five-form responses from the student. For those who saw CAI as ultimate- 
ly assuming a “Socratic" or tutorial role, this was considered critical: for 
those who did not sec this role for CAI, it was unimportant. Programming 
languages were judged not to be a significant problem. 

During the conference. that completed the research process, the pai- 
ticipants evaluated a number of action statements that had been suggested 
for encouraging more widespread use of computers. The 15 on which there 
was the most agreement are presented below. 



A. Research and Development 

Learner control /learning styles . Develop systems that allow more 
learner control of the material and of the style of teaching. 

Educational terminal (graphics/ audio). Organize a team of industrial 
designers, engineers, teachers, and students to develop one or several 
educationally oriented computer terminals. 

Learning theories . Develop a foundation of theories of learning and 
experimental data which would enable the computer to be maximally 
flexible and effective in teaching, as opposed to being a page-turning 
and response-recording device. 

Software format. Establish a format for the production of software that 
will make it usable in a variety of hardware systems. 

Cooperative/competitive. Develop programs in which the student ques- 
tions the computer rather than the reverse (cooperative rather than 
competitive use of the computer in a learning situation). 

Model town. Set up a large-scale model demonstration of CAl-in-thc- 
homc in a new town (200 new towns arc now in some stage of planning 
or construction in the U.S.). 

Learning styles. Develop the capability to identify and match student 
learning styles in different content areas with appropriate pedagogical 
techniques. 
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B. Action and Implementation 

Simulation and gaming. Concentrate curriculum development efforts on 
utilization of the computer’s unique capabilities, c.g., in problem- 
solving exercises, simulation, and gaming. 

Support teachers in CAl development. Identify teachers who arc good 
writers and who have classroom experience in computer applications 
and support them in the writing, publishing, and distribution of quality 
curricular materials. 

Summer workshops. Institute summer workshops to provide teachers 
with hands-on experience with available CAl systems. 

Model schools. Set up one or more CAI-based model schools (elemen- 
tary schools, high schools, or college campuses). 

Cooperative project . Implement a cooperative project involving a com- 
munity college system and a major commercial producer of educational 
materials to develop, test, and demonstrate a remedial course, such as 
remedial English. 

Large-scale demo. Mount a large-scale experiment to demonstrate the 
economic feasibility of CAl. 

Finance teaching of CAl techniques. Finance teacher training institu- 
tions to include practical training in the use of hardware and software, 
and in the techniques of integrating CAl with tlx* traditional education 
process. 

Professional incentives. Establish professional incentives for university 
faculty through a grant program that requires from the recipient univer- 
sity assurance that work on CAl development would be judged equiva- 
lent to research, in terms of promotion, salary, etc. 

The list comes from what was intended to be the final budget allocation 
exercise culminating the workshop evaluations of feasibility, cos t-ef feet ivc- 
ncss, and special benefits. However, the conferees objected that such an 
allocation could be misconstrued as being far more conclusive and signifi- 
cant than was actually the case, especially since the action statements did 
not include any details of implementation. Consequently, it was agreed 
that the allocation figures would not be published. Instead, the list of 15 
action statements simply consists of those statements which received the 
greatest number of allocations, irrespective of the size of the allocation. 
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Chapter IV 



Comprehensive Discussion of Results 



This section contains a description of the questionnaire sequence, and 
extended discussion of the substantive results that emerged from the 
study. 

Question One 

The first major question required participants to estimate the desir- 
ability of, and the computer's potential contribution to, a number of 
presumed educational benefits that might result from the use of computers 
in the instructional process. This section was planned simply to derive a 
working frame of reference as to what the group anticipated would be the 
desirable outcomes and potential contributions of a wide-spread instruc- 
tional use of computers. Consequently, after the first questionnaire had 
obtained a rough degree of unanimity, attention was directed much more 
heavily toward the other sections, giving responses to this first question 
only a slight degree of further refinement. 

The first questionnaire presented 1 1 items for consideration. Respon- 
dents were asked to supplement these with any other educational improve- 
ments they thought significant. Seventy-two additional items were re- 
ceived from this round. From these were chosen three improvements that 
were most frequently suggested; these were presented for rating in the 
second questionnaire. The third questionnaire presented all 14 items in 
rank order and asked for comments wherever a respondent disagreed with 
any evaluation. 

Response to the first question was clear and generally unifomi. There 
was substantial agreement that where adequate facilities and quality course 
materials are available, subject matter can be taught more rapidly, mean- 
ingfully, and thoroughly with the computer’s aid. In general, the group's 
opinion was that the proper use of computers in instruction would make 
education more productive and effective, allow for greater individualiza- 
tion, and provide for greater equality of educational opportunity. 

There was also strong agreement that computers could make their 
greatest contribution to the instructional process by enabling students to 
interact with systems of realistic complexity; c.g., in the physical, social, 
and behavioral sciences, and in business, engineering, and medicine. 



Several other direct educational benefits were identified. For example, 
because they can provide more immediate feedback, computers in ins true* 
tion may afford more efficient learning and perhaps help produce more 
highly motivated student. Also, more widespread computer use might 
provide greater flexibility in scheduling learning programs; c.g.. courses 
could be made available in public libraries, dormitories, or homes. Ratings 
of these and other opinions on the ways computers could be used to 
improve the educational process have been summarized in Table 2. 



TABLE 2 



Response to the first question, "In what ways rtn you believe 
•that the use ot computers in mstiuction would improve the 
eduCiilion.il process*” 

Respondents were requested to (A) estimate the desti ability ot 
each item as an educational improvement, and. ({)) r.ile each 
item as to the computers potential m effecting ti»e improve- 
ment. the bar in the rating grid indicates |ne range foi e.ich 
item containing the middle 50 percent ot responses (tf'e iittr-i 
quartile range), with M indicating the median rating. 

The Hems are ranked in order ol mean ratings, averaged over 

A and B. 



CmniKiler’i Role 




1. Would enable students 10 vwirk with luotibrm in systems nl realistic 
complexity, r q . m sciences. business. engmewmg and medic m*. 



Would iiioyifh* instant leetttsick. with the rnull ot moie HliCienl imi inrw) 



3. Would movitV lot more highly interactive interchange between student and 
body ot tuhiect matter whereby the itudent would mterro>ite and explore, 
rather than assimilate mlormation Iroma teacher, 



WoMd enable itudent lo proceed at own rale, without pressure ol 
lockiteppnv) 



5. Would facilitate llexiM.ty ol leal nmg program wuh legnd to time and place, 
e.g.. couises could be made available in public libraries lot working adults, ot 
•n hornet. 



Would make it possible ?or educational program* to be more accurately and 
lign.l.cantly evaluated, allowing systematic revision of couue malenal to 
optimize leaching effect rveneti, 



1 . Would bee the teacher bom the more routine, dull -and practice aspects of 
leaching 



8. Would make possible immediately available record! cm ttudentt' learning 
hntoiy, facilitating greater ind'mduab/ahon. 



9. Would encourage a mote fieely questioning attitude by removing tear ot 
making errors or asking inappropriate questions. 



10. Would help to insure brn fiec educational environments lor minotily V oup*. 



ft. Would shill the emphasis in itudent evaluation toward attainment ol obieclive 
learning cirteiia and avsuy from placement in a normative cuive. 



12. Would piovide a more controlled learning environment: itudent not as subject 
to the negative influence ol poor teaching. 



13. Would enaNe itudent to select hit own learning sequence. 



M. Would bee student to concentrate on malenal lo be learned without pressure 
ol compeniron bom peers, 
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Questions Two and Three 

The second major question asked respondents to evaluate the problems 
that have kept CA1 from being more widely developed and accepted. In 
the first round, a list of 23 possible obstacles was presented and respon- 
dents were asked to rate these and suggest additional items. From the 49 
additional items that were returned, 16 were added in the second question- 
naire and were rated along with the old items, which wore organized into 
categories. In the third questionnaire the list was presented again for 
rating, in category format. Within each category tlie following two ques- 
tions were asked: 

Do you feel that this is an accurate representation of the problems in 
this area? (What comments would you add to make the picture more 
complete?) 

Do you feel that the nature of the problems in this area differs signifi- 
cantly for different levels of education (c.g,, prccollcgc and college)? 
If so. how? 

A few representative comments that touclted on key issues wore also pre- 
sented in each category for the respondents to agree or disagree with. 

The third major question requested suggestions for overcoming the 
obstacles identified in Question Two and for facilitating the growth, in 
value and acceptance, of CAI in the future. The 80 suggestions received 
from the first questionnaire were edited and reduced to 38 items, or- 
ganized into categories, and presented in the second questionnaire for 
ratings. In the third questionnaire, the three most highly rated items in 
each category were presented, and the respondents were asked “Arc there 
other suggestions that you believe arc more important than these?” In 
addition, in a final section of the third questionnaire, the respondents were 
requested to outline two or more action plans, based on one of the three 
suggestions in each category, or any additional idea they felt was worth 
exploring. These action plans arc presented in original form in Appendix 4. 
Tlwy provided most of the 83 action plans considered at the conference. 

The sequence used was not a strict Delphi application. It soon became 
clear that CAl has too many dimensions for a simple iteration of rating 
refinements to achieve the substantive overview that was the goal of the 
study. The sequence did, however, stay within the spirit of the technique 
in feeding back inputs for clarification and sharpening of focus. 

Some convergence was obtained in the item-rating of obstacles (sec 
Appendix 3). It is interesting to note that the Questionnaire 2 ratings, in 
which the Questionnaire I data were presented in bar-graph form and a 
simple rerating was requested, did not converge significantly. That is, re- 
spondents were not moved to change their ratings by seeing the group 
data. With Questionnaire 3, however, respondents were asked to comment 
wherever their final rating fell outside the interquartile range of group 
responses for each item. Here there was substantial convergence, as would 
be expected. Evidently, feeding back group data, without requiring an 
explanation for disagreement with the majority, docs not result in a refine- 
ment of consensus. 
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The responses to Questions Two and Three were numerous and diverse. 
So that these could be more effectively considered, they were grouped 
into categories. The objective in selecting the categories was to reduce the 
effort required of the respondents by providing a degree of organization 
while superimposing only a minimally artificial structure. The six cate- 
gories finally settled on. after some revision during the sequence, were 
these: 

(a) Production and Distribution of Instructional Materials 

(b) Demonstration 

(c) Theory of Instruction 

(d) Educational System and the Teacher 

(c) Cost 

(f) Technical Research and Development 

In the following discussion of results, the questionnaire data, confer- 
ence dialogue, and action plans are interwoven in a description of the 
overall issue of CAI acceptance as seen by the project participants. The 
report is written in such a way as to reflect what seems to be the generally 
held opinions, while making distinct the issues that provoked disagree- 
ment. The attitudes expressed are not the authors’; rather they indicate 
what the authors feel were the group’s views. The discussion is organized 
into the categories listed above, with a brief introduction to each describ- 
ing general areas of agreement and disagreement. 

A. Production/Distribution of Instructional Materials 

Obstacles identified in this category grouped themselves as problems of 
lack of interest in, diffusion of responsibility for, and lack of incentive for 
(lie development and distribution of computer-based materials. Table 3 
displays specific factors relating to the production and distribution of 
instructional materials that were judged to be significant impediments to 
widespread computer use. 

There was substantial agreement that the inadequate supply of effective 
instructional materials was the most serious short-term obstacle to wide- 
spread use of computers in the instructional process. The problem which 
received the highest ratings in terms of importance in the entire question- 
naire was Item I: the lack of good, readily available computer-based edu- 
cational materials. The consensus of (lie group was summarized by one 
respondent: “Adequate course materials seem to be the key variable. Hard- 
ware is now available, and improvements will be made continually. How- 
ever, course development is slow and needs far more attention. The quality 
of CAI will be determined by the quality of the materials inserted into (lie 
computer. “ 

The reasons for the scarcity of good materials arc complex and inter- 
related. Generally, they have to do with \c lack of established production 
methods and procedures, the lack of professional and economic incentives, 
and the vagueness of market prospects. It was the majority view that a 
market must be established, initially with federal backing or incentives, 
but eventually self-supporting, and that attractive and marketable new uses 
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TABLE 3 



Production fdistubulton of msfrucborwl materials. This cate* 
gory dealt with problems of interest, responsibility and incen- 
tive in the development and distribution of computer-based 
materials. The first item, “lack of readily available and good 
computer based educational materials *. was the most highly 
rated item in the study. 



The bar in the rating grid indicates the range for each item Con- 
taining the middle 50 percent of responses (I he interquartile 
range), wilh M indicating the median rating. The items are 
ranked in order of mean ratings. 



I. Lack of readily available and good computar-baied educational materials. 




12 3 4 5 



2. Lack of professional and economic incentives lor development of 
compute! -based materials. 



3. Lack of incentive for faculty members to expend any considerable time and 
effort in modifying, or creating alternative, instructional methorb. 



4. Lack of incentives for dissemination of softmu.a. 



5. The lack of personnel with appropriate training and talant in the diverse 
disciplines required,' i,e„ instructional psychology, computer science, 
engineering, educational administration, ladio-TV-film. 



6. Application of the "textbook" or iingla-author model to curriculum 
production instead of the "movie production" model mvohnng • highly skilled 
differentiated team. 



7. Lack of initiative with reprd to distributing software and providing training 
end services for its users. 



8. Lack of standardization of computer systems, limiting free exchange of 
software. 



9. Lack of appropriate mechanisms for protecting patsnts, copyrights, etc,, for 
CAI mater left, 



10. Lack of an organization to facilitate interchange of CAI propam materials. 



of CAI, such as simulation, gaming, and problem-solving, should be devel- 
oped. There was, however, some feeling that this was essentially a “stock- 
holder” approach, with its emphasis on commercial development of CAI, 
and that such a limited viewpoint does not meet the magnitude of the 
educational problem, nor the urgency of the need for change. 

Within this first category (Production and Distribution of Instructional 
Materials), the major concerns can be grouped under the following head- 
ings: new directions, the author, incentives, the market concerns of the 
publisher and of hardware and software manufacturers, market develop- 
ment, production models, royalty and copyright, standardization, and 
national organizations. Specific concerns in regard to each of these items 
are summarized as follows. 
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New Directions 

More imaginative, effective, and marketable forms of CAl need tube 
developed*** (see Section C, Theory of Instniction. for further commen- 
tary), Overemphasis on tutorial and drill and practice applications, and 
insufficient emphasis on other instructional strategics, have had a stulti- 
fying effect on CAPs growth. Consequently, computer use in education 
will be strictly limited until new and striking areas of exploration arc identi- 
fied and developed. One promising direction for effort is the area of 
simulation and gaming, an area in which the computer provides capabilities 
that cannot be duplicated by any other instructional means. Compara- 
tively little luis been done to enhance the computer's use in this area. The 
creation of effective simulation and gaming materials should he a major 
goal in developing a substantial and viable CAI market, and in furthering 
CAI acceptance.*** (See Tables 2. 3 and 5.) 

The Author 

In the third questionnaire the following question was asked of the 
participants: “Who arc most likely to be the primary producers of CAI 
course materials?*' Only brief responses were requested, but the answers 
serve to indicate the general orientation of the group in approaching the 
problem of author incentives. Of those responding, seven named university 
or college faculty as the most likely authors. Seven others listed the private 
sector - i.c., publishers, instructional-materials houses. Several in this 
group added that CAI materials would be produced in the same way as 
textbooks, but with experts in production techniques to backstop the 
authors. Six of the remaining responses focused on various team ap- 
proaches to materials development. (See Appendix 2.) 

Incentives 

A significant problem, particularly at the level of higher education, is the 
absence of economic and professional incentives for designing, developing, 
and distributing CAI materials,*** (See Item 2, Table 3.) Incentives arc 
particularly important at the university level, where there is the greatest 
potential for development of materials, as noted above. At the university 
level the lack of professional incentives stems from the general disinterest 
in improving teaching methods (Item 3, Table 3), Current academic incen- 
tives practically ignore the development or improvement of instructional 
techniques. Thus the participants generally agreed that more resources 
should be directed toward recognition of technological applications in edu- 
cation and toward revising the academic reward system.** Incentives com- 
parable to those provided for disciplinary research should be made available, 
he., financial rewards, prestige, and enhancement of career. In effect, this 
would mean a legitimization of work in the area. 

Part of the difficulty is that the production of computer-based 
materials is far from the point where the writing ofCAl materials could be 
equated to the writing of textbooks. Consequently, many university 
faculty Mil have to be willing to undertake intensive, and perhaps exten- 
sive, personal education in computers and CAI techniques. This difficulty 
may be partially obviated by using a team approach in which the author is 
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supported by a technical team. Nevertheless, faculty members now derive 
little advancement, and indeed are often penalized, for devoting more than 
a fraction of their time to refining teaching methods. Progress will be 
retarded in developing good college-level computer-based materials, and 
new instructional methods, unless or until the prevailing counter-incentives 
arc removed.* 

Elementary and secondary school teachers arc also affected by the 
absence of professional incentives for involvement in the formal develop- 
ment of course materials. However, as discussed in Section D (Educational 
System and tlie Teacher), they are less likely than university faculty to 
have the lime, skills, or resources required for courseware development. 

The issue of economic incentives is very different from that of profes- 
sional recognition. It is not a problem of arranging appropriate incentive 
structures for CA1 authors. Rather, it is one of determining where the 
money will come from to provide the incentives.* As one spokesman for 
tlie publishing industry observed, "The appropriate incentive structures arc 
already available and are simply waiting for the market to develop. All of 
the techniques of payment are there. There is no lack of willingness to pay 
generously for the work; there is just the question of which is more practi- 
cal in a given case.’* In other words, once there is a market supplying 
money to develop CAI course material in some sizable quantity, the 
needed materials will be developed and publishers will quickly resolve the 
royaIty-versus-suIary-vcrsus-"someihing else” incentive problem. (It might, 
however, be noted (hat this reasoning is circular, since a market probably 
cannot be established unless good materials of demonstrated effectiveness 
arc available to begin with. There is a further discussion of this point in 
Chapter V, Conclusions and Recommendations.) 



Market 

A market success for CAI is critically needed to catalyze public and 
private investment.** Investment is clearly needed by hardware companies 
as well as publishers or software producers. The kind of market that could 
give rise to such success would have to present sufficient volume lor mass 
dissemination and should also offer low social resistance to change.* Many 
of the CAI programs and applications that have been developed are in 
advanced college-level topics and arc so innovative that they do not have 
impact on high-volume courses. Many other CAI developments are adjunc- 
tive to the regular instructional system, representing an add-on cost rather 
than Jt replacement cost. They therefore do not promise the economic 
impact that can stimulate strong motivation for social changes. This issue 
was raised in detail throughout the questionnaire and conference phase of 
the study, with several significant viewpoints emerging from tlie inter- 
action of the study’s participants. The viewpoints of two representatives 
from the commercial sector are discussed below. 

a . The Publisher The critical questions directed at publishers are these: 
a) why haven’t they been induced to invest their own money in achieving 
CAI success? and b) what are the reasons for the relatively modest amount 



of publishers* money invested in specifically CAl materials as distinguished 
from the very large investment in other program materials? 

The answer, in large part, is skepticism about the success of CAl as an 
alternative leaching technique and skepticism about the likelihood of 
developing a viable market in the near future. Even if publishers were 
confident of CATs eventual effectiveness and profitability, they would still 
be faced with many kinds of investment necessary at this stage of develop- 
ment which are not the sort of investments that commercial sale of 
materials can recover. For example, when a publisher is producing a con- 
ventional textbook, he does not have to invest money to find out how to 
write textbooks. That information is already common knowledge, and 
writers know how to use it. Also, the publisher does not have to invest in a 
marketing effort to try to persuade customers to invest in his type of 
product. The public — that is, the school system — already buv c *xt- 
books; the publisher need only persuade potential clients to bi., v .pe 
of book. But if the publisher is in the CAl field, he must first work toward 
establishing a market for CAl products. He has to invest both in the pure 
research that underlies production and also the specific research and test- 
ing of his particular product. Furthermore, his marketing effort has to be 
addressed toward inducing the school to use CAktcchniques as well as his 
materials. Clearly the market will not now support that level of invest- 
ment. 

Nevertheless, that docs not mean proper financing cannot be raised. For 
example, the publishers might be induced to make a considerable invest- 
ment, on a shared-risk basis, if comparable government or foundation 
support could be provided. The shared funds could be used to support the 
research and development necessary to establish production techniques, 
procedures for duplicating and disseminating materials economically, and 
related requisite activities such as teacher-training workshops. This would 
not simply be basic research on instructional technology, but rather an 
effort to establish, or at least prepare the groundwork for, a sizable 
market. 

b. Hardware and Software Manufacturers A representative of a large 
manufacturing firm said that an impressive sum had already been spent for 
CAl only to confirm some very simple and, at least in hindsight, obvious 
conclusions. One such conclusion was that trying to design special 
hardware and software for educational purposes was a mistake. There is 
loo great a gap between design requirements for education and those for 
business or science, and the computer market in the latter areas is already 
extensive and well established. Although some work may continue on 
specialized temiinal development, manufacturers should not go out of 
their way to support markets that arc exclusively educational. 

Another conclusion was that the course material problem is more diffi- 
cult than expected. It is not, as they had hoped, simply and satisfactorily 
resolved by an alliance with a publisher. The publisher's role typically is 
not to develop materials, but to scout for, edit, package, and sell them. 
Unfortunately, if there is no readily available source of materials, the 
publisher is not necessarily prepared or motivated to create it. 
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A final problem was iliai in most tutorial and drilland-practice applica- 
tions, computer-presented subject matter did not produce any better re- 
sults than traditional instructional methods, nor any savings in cost. Al- 
though this might have been the fault of the material rather than the 
method, it led to their conclusion that such applications of CAI arc. for 
the loreseeable future, a very poor business proposition. 

It should be noted here that a majority of the participants did not 
concur with the manufacturing spokesman in opposing development of 
hardware designed especially for educational use. Rather, the lack of ap- 
propriate hardware for CAI was judged by most to be a problem.** (Sec 
Section F, Technical Research and Development.) It thus seems that when 
this problem is ultimately resolved it will not be through the efforts of 
large manufacturers, at least in the near future. The resolution, it was 
suggested, will probably come through small and innovative hardware com- 
panies, ready to take large risks for the market returns that could be 
obtained from a well-received CAI hardware system. 

Market Development 

Federal lunding will probably be necessary to resolve the stalemate over 
economic incentives and to stimulate the growth of the market.** The 
cost of preparing materials is so high and the investment so risky that 
sources of substantial investment other than the government arc unlikely. 
Clearly, authors will not be easily persuaded to devote many years of hard 
work developing a program that may never sell, nor will publishers be 
quick to accept the risk of paying authors for their time, without the 
demonstrable need that assures a market. The alternatives arc a broad 
program of federal funding or a liberal federal policy regarding support for 
private research and development. 

There were a number of suggestions as to ways in which federal financ- 
ing could support the production and marketing of CAI materials. Some 
involved subsidizing development of instructional materials within cacli of 
the major disciplines. For example, discipline-based groupings (like the 
NSF-sponsored Commission on College Physics) might be established. 
These could draw upon prominent scholars in the discipline to develop 
curricula that imaginatively exploit the computer’s full instructional cap- 
ability. Their materials could then be offered for commercial distribution, 
with royalties shared by the authors, the commission, and the government. 
Other proposals were less concerned with facilitating disciplinary develop- 
ment of computer materials. One suggestion, for example, emphasized the 
importance of drawing in professionals of high intellectual caliber who also 
have a deep understanding of both computers and education. A significant 
problem has been tlie lack of persons with appropriate training and talents, 
as indicated in Item 5, Table 3, Because professionals with such specialized 
talents and broad interests are at present rare, a primary goal would be to 
establish research institutes and programs to attract and train them.* 

There was also emphasis on forming commercial groupings and coopera- 
tive research teams to study, develop, and experiment with CAI pro- 
grams.* These might be initially encouraged by government support; how- 
ever, once a solid market was available, they would continue on a com- 
mercial basis. One associate of an educational computer center thought 
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(hat. instead of paying authors for developing course materials, educa- 
tional computer centers might sell their services to an author-publisher 
lejm. That is, universities could be subsidized to provide technical support 
and computer time for curriculum development purposes. Publishers then 
could be encouraged to seek out authors who are talented in a particular 
area and to buy, at reduced rates, the required technical support services. 
In this case, the author could receive a royalty incentive from (he pub- 
lisher, and the publisher could purchase reasonably priced services without 
having to invest in their development himself. This procedure would be an 
alternative for structuring program development that provides proper 
incentives for authors and relieves publishers of a prohibitively high capital 
investment. 

A participant involved in curriculum production recommended gelling 
individuals interested in CAI design and development to incorporate as an 
organization. The corporation would go to the publisher for advice, for 
marketing services, and possibly for initial financial backing. To in- 
corporate, of course, would unquestionably involve heavy investment, 
either by the development group or the publisher or both. Again, federal 
subsidization would probably be needed to carry the venture until the 
market was large enough. 

Production Models 

In the development of CAI materials the continued reliance on the 
"textbook-author" model instead of the "movie-production" model has 
p.ovcn to be another problem** (see Item 6, Table 3). The CAI medium is 
technologically complex, and a thorough knowledge of its technical cap- 
abilities is essential to full utilization. One might conceivably find talented 
authors who have combined expertise in presentation techniques, com- 
puter science, and academic disciplines; but such a combination would 
have to be rare, given the demands of specialization in any one area. 
Consequently, a task-force approach, deploying a highly skilled, differ- 
entiated team that divides the responsibilities of authoring, formatting, 
and programming, may be necessary. 

To suggest such an approach is not to deny that many successful teach- 
ing projects have been designed by individuals. Indeed, most major curricu- 
lar reforms, particularly at the college level, have been effected through 
texts produced by one or two authors, and not by large curriculum devel- 
opment teams. However, there was no need in these cases for extensive 
technical support, as there would be in CAI development. 

Royalty' and Copyright 

Legal control of CAI materials was an issue which received discussion 
among several conferees (see Item 9, Table 3). The author's right to con- 
trol the content of a book indefinitely is traditional in royalty contracts, 
but this is a tradition that the publisher cannot afford to follow when he is 
dealing with CAI materials. Publishers should have the right to control the 
program’s ultimate content since they need to have the flexibility to im- 
prove instructional materials as the materials go through iterations of use. 
An appropriate option for the CAI author might be the prerogative to 
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remove liis name from any revised program, while continuing to receive 
royalty, but not the right to control indefinitely what is in the program as 
it goes through the recycling process. The issue is that greater economic 
reward through increased royalties simply may not be sufficient incentive 
to the author to improve his materials; however, the possibility of periodi- 
cally improving or updating materials would be attractive to the publisher. 

Copyright is an issue related to the control and content of course 
materials. Although the project participants did not consider copyright 
laws to be a factor which significantly inhibits acceptance of computers in 
instruction, they did stress the need for a copyright structure that protects 
the lax, foundation, and private money invested in developing new mater- 
ials. The basic need is for a flexible policy that safeguards the public 
interest by allowing widespread dissemination of materials generated by 
research, but at the same time permits varying degrees of copyright protec- 
tion.* 

Standardization 

The issue of standardization represents a substantial obstacle to 
broadening the CAI market (Item 8, Table 3). It is possible that if there is 
nm more quality control and standardization, the result will be a weak 
market (hat will not compete with other instructional materials.* Edu- 
cators are already somewhat bewildered by the profusion and variety of 
technological aids. 

The key question is whether CAI will turn out to be a relatively uni- 
form technology that easily permits transfer of materials, programs etc., 
from system to system. The alternative to uniformity would be a vertically 
arranged organization where whoever provides hardware would also pro- 
vide the accompanying software and course materials. That is, CAI systems 
would be sold in packages, with one company providing all requisite equip- 
ment and services for the package. Standardization, on the other hand, 
would permit separate and independent markets for course materials and 
hardware, respectively. Thus the viewpoint of those who want to see a 
broad-based and open market for course materials is that standardization is 
a logically necessary first step. 

National Organizations 

The problem that was of least importance among the questionnaire 
items (see Item 10, Table 3) was the lack of an organization to facilitate 
interchange of CAI materials. It was felt that there are already several 
publications devoted to describing the characteristics and availability of 
CAI courseware, and that more will appear as the production of materials 
increases. The limiting factor is the lack of awareness that these infor- 
mation resources exist. 

In a slightly different context, it was agreed that more national leader- 
ship is needed to coordinate CAI development and its adoption into 
schools. In Questionnaire 3 (Appendix 2), 22 out of 28 responses agreed 
with the statement (hat “national centers arc needed to do research, to 
develop resources, to study policy questions, develop strategics, cle.*' The 



educational reforms that effective CAI use will necessitate are of a highly 
intricate nature and will require careful analysis and planning. 

One conferee suggested that accrediting agencies might serve a leader- 
ship function in setting minimum standards for computing which would 
draw' schools toward a broader and more effective use of CAL However, 
the majority argued that this approach would encounter serious problems, 
ll is very difficult to frame minimum standards to bring about a desired 
effect; it is much easier for agencies to write checklists based on such 
simple determinations as academic degrees held by the faculty or number 
of books in the library’s collection. Poorly conceived criteria would hinder 
rather than help the development of CAL 

B. Demonstration 

A persuasive demonstration of the benefits of computer-based instruc- 
tion was judged to be a critically important step in gaining acceptance for 
CAL There was strong agreement that there are presently far too few 
examples of effective CAI use. A few participants expressed the belief that 
the supposed resistance of the educational system and the educational 
market to CAI is based solely on the lack of compelling evidence that CAI 
is, in fact, more effective than other instructional media. 

There were several points of disagreement with regard to the kind of 
demonstration (hat would be appropriate. On one hand, the following 
viewpoints seemed to form a logical grouping CAI is ready now for a full 
demonstration in certain applications; a demonstration should not involve 
such a revolutionary application oi CAI that r’inatioit would be 
hindered; the demonstration should prove the econo?„*c feasibility of the 
system so that it can be adopted directly by schools. The opposing view- 
points were these: CAI requires further exploration and large-scale experi- 
mentation before it will be ready for demonstration; CAI should be used 
to implement needed radical changes rather than be tailored to present 
systems; and demonstrations should be oriented toward proving that CAI 
can offer clear advantages in quality of instruction, rather than toward 
emphasizing its economic feasibility. 

Differences seemed to stem from conflicting views as to how CAI will 
develop; these were similar to the divergent views noted in Section A. One 
view seems to be that CAI is basically another instructional medium like 
books or TV, paiticularly useful in some areas; and once a market is 
established, CAI will continue to develop from commercial incentives to 
improve it. An alternate view seems to be that education must be re- 
oriented on a technological base so that instruction can be improved in a 
systematic way, as is needed in an increasingly technological world; CAI 
provides an exceptional means for providing such a base and should be 
carefully developed on a large scale with extensive long-range societal and 
governmental support. 

Specific factors relating to the issue of demonstration that emerged in 
the questionnaire sequence are listed in Table 4. Topics receiving discus- 
sion were: large-scale CAI demonstrations, quality and feasibility, educa- 
tional level, and likely areas for successful demonstrations. Specific con- 
cerns in regard to each of these items are as follows: 
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TABLE 4 

Demon sir jfion. Responses in this category pertained to the 
lack of a well- designed, convincing demonstration of the bene- 
fits of computer-based instruction. 
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1 . Too few examples of high quality um. 








M 




2. Lack of compelling evidence that CAI «s more effective then other method! q| 

comperefaf e cost. 








M 




3* L*®* °* carefully planned broad programs of CAI experimentation in actual 

school setting!. 












4, Failure to design curricula end systems for high-impact, low- resilience 

"markets** vrfiere real institutional problems can be solved. 








M 




5. Lack of "oiticel mats" in setting up programs. 













Large-scale Demonstrations 

Opinion was divided on GAPs readiness lor large-scale demonstration. 
Of those responding, sixteen agreed that “more trial and error is needed 
before CA1 is ready for the risk of a large-scale demonstration”; 1 1 dis- 
agreed (see Appendix 2). While there was general agreement that a need 
presently exists for setting up large-scale CAI systems, some saw the effort 
as a means for demonstrating the feasibility of CAI; others, however, saw 
it as only a beginning of the kind of extensive experimentation that is 
needed at this stage of development. 

On one side, it was felt that enough is now known about CAI for 
successful large-scale demonstrations to be mounted without further ex- 
perimental exploration. Such demonstrations, it was suggested, should 
focus on a few specialized and carefully developed forms of CAI, If CAI 
can be successfully demonstrated in one or two important and realistic 
applications, it would probably be widely adopted for those uses. Once the 
equipment and expertise begin to appear in the schools, other applications 
would much more readily develop. 

On the other side, a more cautious viewpoint was advanced by some 
participants. They agreed on the need for continued experience with day- 
in-day-out use of numerous terminals in a comprehensive, standard cur- 
riculum. But projects should be undertaken with a view toward explora- 
tion and development, rather than demonstration of universal feasibility. 
Demonstrations can become important only after several fully effective, 
validated programs have been developed in this way. 

The idea of “critical mass” in the size and funding of a CAI demonstra- 
tion is important.* When funds have been available in the past, they were 
typically insufficient both in amount and in duration. Yet a critical mass 
<;f resources is crucial if the full range of interlocking educational problems 
is to be solved. The research and development effort with a narrow focus 
CO technology alone is by its very nature bound to be insufficient. By 
analogy, a space program with developmental projects limited solely to 
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boostcts or (he launching pad would never have landed a man on (he 
moon. The lull range of requirements for systems must be identified, 
funded, coordinated, and projected over time with “benchmarks" to mea- 
sure progress, and to insure effective management. There might be several 
massive experiments, on this order, designed to crack the cost/qualitv 
barrier. 

One respondent suggested the idea of a balance between the minimum- 
scale demonstration that would show an economic or educational advan- 
tage and the maximum-scale demonstration that could be adopted by tradi- 
tional schools without major reorganizations. To have a demonstrably 
beneficial impact on a school's functioning, a CA1 system would have to 
be used fairly extensively. At the same lime, if the demonstration system 
wetc too elaborate and required schools to completely make over their 
established organization, it would hinder wide dissemination.* 

Conversely, some participants judged such massive reorganization to be 
exactly what is needed*, indeed, they felt that the best function of CAI 
might be to implement (his kind of radical change. 

Quality and Feasibility 

There was a clear division of participants as to whether the primary 
orientation of CAI demonstrations at this time should be toward demon- 
stration of higli quality instruction or demonstration of economic feasibil- 
ity. Those in favor of demonstrating high quality felt tluu cost was irrele- 
vant. They argued that one should wail for a convincingly dramatic dem- 
onstration before considering how to achieve the same results more 
economically. On the other hand, those who favored a demonstration of 
economic feasibility felt that to be more important, especially in view of 
the current financial retrenchments in education. It was (heir belief (hat 
higli quality instruction will come naturally as experience accumulates and 
talented persons move into the field. As long as schools cannot afford CAI. 
the quality of programs is of secondary importance. This division of 
opinion regarding cost and quality seemed to be based on some more 
fundamental expectations of how CAI will develop. On one side, it was 
assumed (hat equipment costs will drop because of ordinary market pres- 
sures, and (hat CAI will benefit from further exploration of its instruc- 
tional potential. On the other side, the concern was voiced that CAI can- 
not even begin to take root until costs become more reasonable. As 
schools begin to accept (he concept as well as the costs, (he refinement of 
programs will take place automatically. 

Educational Level 

Thcic are wide differences between the type and size of demonstrations 
likely to be successful for prccollcge and those aimed at college-level 
instruction.** Three main factors were considered: (a) Computer re- 
sources (hardware and personnel) arc established and available at the 
college level. Their prior availability scents to lead to greater acceptance of 
conceptual demonstrations and willingness to build unique systems begin- 
ning with the demonstrated concepts. At the elementary-secondary level, 
however, a complete package must be demonstrated because of the lack of 
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available computer resources. This package must include a hardware sys- 
tem m addition to computer programs, teaching aids, materials, etc. 
Because such a package is expensive, the demonstration must be all the 
more thorough and convincing, (b) The teacher at the precollege level has 
only a limited control over facilities and materials, most of which are 
chosen by statewide boards or district administrators. At the higlter educa- 
tion level, the individual instructor has much more control, subject pri- 
marily to financial restrictions. The implication of this difference is that 
initial demonstrations at the elementary-secondary level must be designed 
to convince administrators of the virtues of CA1: while at the university 
level they must convince the instructors, (c) Another important factor is 
that at the prccollegc h^vel CAI is likely to be competitive with existing 
modes of instruction, displacing persons and methods, and hence pro- 
voking resistance. At the university level, however. CAI programs extend 
rather than replace ongoing programs, and enhance the sponsoring profes- 
sor s status: hence dicy require less conclusive demonstrations of value. 

Areas for Successful Demonstrations 

Considerable attention was devoted to identifying areas in which CAI 
could be successfully demonstrated. In Questionnaire 3. the question was 
asked: "At what level or in what area of education would CAI be initially 
most effective and most likely to induce a widespread acceptance?’* The 
most frequent suggestion was to use CAI in leaching basic skills, such as 
math and English, either at a precollege level or in remedial and introduc- 
tory courses at junior or community colleges (see Appendix 2). Other 
suggestions that emerged from the study (several overlap the basic-skills 
suggestion) were: remedial programs for the disadvantaged; curriculum 
development within a discipline; advanced college-level uses; community 
colleges; education for the handicapped; and vocational, industrial, and 
military training. 

Remedial programs were judged a particularly appropriate sector in 
which to invest CAI efforts.** Specialized use of computers in remedial 
education could provide broad subject-matter coverage to numerous stu- 
dents and simultaneously afford substantial justification for using educa- 
tional funds for this purpose. For example, providing remedial education 
for urban minority children, especially in combating the reading retar- 
dation problem, could be a particularly appropriate initial use of CAI. As 
one respondent suggested, "major concentration should be on designing 
two or three alternative CAI programs aimed st this specific problem. The 
social needs arc greatest there, and the resources for funding research and 
development and for actually buying and applying developed materials arc 
greatest there. Moreover, successes in this sector would attract wide atten- 
tion and lead to much fuller support for further extensions and appli- 
cations of CAI.” A caution was noted by one participant that if CAI were 
to become associated in the minds of tlie educator with primarily remedial 
education, it would run the risk of being relegated to that use in the 
future. 

Development of high-quality computer-based courses within a partic- 
ular discipline was considered a useful way to advance CAI.* Recom- 
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mcndations were made to support the development, in one or more 
disciplines, of a complete curriculum that would make heavy use of the 
computer and other instructional technologies. For instance, a program 
similar to the one that resulted in the PSSC physics course might be 
instituted. This program would involve a single strong thrust toward a 
carefully designed course, with participation by interested, qualified 
teachers from all parts of the country, and with summer institutes for 
teacher training. Such an effort should entail developing high quality 
materials, using the best talents, and serving a specific function: the 
program should not be under pressure to serve a large number of students 
immediately. 

Community colleges were considered to be an important sector for 
demonstration because they are newly developing and do not have 
traditions and long-standing practices to overcome.* CA1 applications in 
the community college could be designed to satisfy unmet needs, rather 
than to displace or replace other wclhcstablished materials. Also, since 
community college instructors arc frequently confronted with the problem 
of providing a substantial amount of remedial instruction, they might 
welcome any assistance in making such classes more effective. 

Similarly, teachers at large universities might be receptive to procedures 
that minimized their teaching time,* Their careers, their professional 
prestige, and their advancement do not, in many cases, depend on their 
teaching accomplishments. Consequently, they might welcome any tech* 
nique that enabled students to learn at least as well as they do now. with 
less investment of time and effort on the teacher's part. Applications at 
the undergraduate level would be most successful if they dealt primarily 
with basic factual material, in which tltc humanistic mystique of personal 
instruction is least likely to be embedded. Other successful applications at 
advanced levels could take the form of diagnostic problem-solving, simula- 
tion, and gaming. One might also anticipate ready acceptance of CAI in 
those professional areas, such as medical technology, that need continually 
to update, i.e., to keep current with new techniques, new processes, and 
new information. 

Another good prospect for CAI demonstration is education for the 
handicapped,* The payoff has been great in past attempts to develop 
technological services for special education. For example, an attempt to 
develop CAI materials for the visually handicapped could concentrate at* 
tention upon the legibility of the display panel. This diction of research 
would provide benefits beyond satisfying the needs of the visually handi- 
capped. To be able to present more information on the screen arid d*> it 
more legibly would provide benefits for all forms of CAL CAI rcseasch has 
not been pushed far enough forward in a number of place . vvlienr if might 
have been very appropriately used. If attention is focused on specific 
ptoblems. such as the handicapped, tltc nel impact of those particular 
programs will be increased and the outcome that much more impressive as 
a demonstration. Adequate funds are available for research and develop- 
ment in special education. Consequently attempts to aid socially needy 
groups like the handicapped have good promise for sufficient support. 

Several participants suggested the advantages of successful demonstra- 
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(ions outside (he education sector.* They noted that CAI is most frequently- 
discussed in the context of traditional education where its use encounters 
the most difficult problems. To build up confidence in CAI, why not 
promote convincing demonstrations in types of instruction that seek to 
provide measurable skills in measurable amounts of time? Such appli- 
cations can be found in military and industrial training, and perhaps also in 
the trade school curricula* Consequently* these areas seem to offer par- 
ticularly promising targets for initial CAI development. 

C. Theory' of Instruction 

The need to acquire greater understanding of the instructional process, 
and to use this knowledge in developing innovative and effective CAI 
materials, were judged to be problems of long-range importance. There was 
agreement that the computer's potential is far from being fully utilized in 
present CAI systems - in fact, in many applications the computer serves 
merely as a page-turning, response-recording device* The majority view 
maintained that more emphasis should be placed on developing the com- 
puter's many unique capabilities* and that such development would be 
prerequisite to demonstrating the true advantages of CAI over other in- 
structional media. 

There was disagreement as to whether such an effort to fully refine CAI 
techniques should involve extensive basic research in learning processes, or 
whether it should be on an applied level* Some participants stated that 
learning theory research is irrelevant to CAI design; the opposing position 
was that effective CAI materials cannot be created and improved in a 
systematic way without solid theoretical grounding. The resolution of the 
dispute seemed to lie in a qualified statement that current learning theory 
is generally irrelevant to CAI design, but there are areas where data collec- 
tion and theoretical analysis are enormously important for CAI develop- 
ment, particularly the data deriving from CAI use itself. 

The pertinent factors that were rated in the questionnaire sequence are 
shown in Table 5. As with previous categories, the diverse concerns of the 
participants regarding this area can be grouped in several subcategories: 
learning theory, unique capabilities of CAI, research use, and learner 
control. 

TABLE 5 

Theory of instruction. Responses in this category deatt with 
the need to adopt new and different approaches for developing 
effective CAI materials. 






t 
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1. Failure to recognize that material must be completely reorpniicd end 

restructured it it is to be taught effectively with computet stems. 








M 




2. Inadequate development of a range of computer* based pedagogical techniques. 

The range might include question-answers, tutorial, cfrill and practice, 
simulations, games, problem solving modes, etc. 








M 




3. Tendency to put too much "on the computer” rather than share the 

presentation and testing of curriculum objectives with other instructional 
media. 








M 




4. Lack of experimental data and theories in learning psychology which would 

facilitate the design of effective CAI programs appropriate to each age level. 
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Learning Theory 

One issue that elicited a variety ot* opinions was the need for more basic 
research on the psychology of learning. It was the opinion of* some that a 
major impediment toCAIs acceptance was the lack ot* theories of learning 
and experimental data concerning the learning process. In their absence, 
we have attempted instead to use computers as a way of* mechanizing 
programmed instruction procedures that have appeared to be effective. We 
have not vet developed the means to use computers in different ways more 
appropriate to their special characteristics and abilities. Consequently, the 
computer’s unique flexibility in problem solving, simulation, and inter- 
active dialogue has not been fully utilized by existing CAI sequences. 
Continuing large-scale research needs to be conducted in order to develop 
and refine techniques in the areas of instructional strategy and logic of 
presentation. 

Several participants were flatly opposed to the statement of a need for 
more basic research in learning theory. Their contention was that an at- 
tempt to take current theories of learning, which involve very vague and 
abstract models, into full account in designing programs would require far 
more sophisticated capabilities than are presently provided by any C’AI 
system. Others agreed with the somewhat different view of a participant 
who felt that there arc some very valuable areas of research, such as in 
problem-solving strategies, but that "research on contemporary learning 
has been cither at the level of too great generality, or in the case of 
differential schedules of reinforcement, at a level of too great specificity, 
very useful for pigeons in drug studies, but uot much use for students in 
the tutorial mode.’* 

Unique Characteristics of CAI 

The computer as an instructional medium is quite unlike traditional 
media and needs further study in some areas.** Four differences between 
the computer and other instructional media were particularly underscored: 

1. The procedures for the development and structuring of CAI mater- 
ials vary from those traditionally employed in other instructional 
media. 

2. The computer’s vcrr»iility in assuming a variety of roles offers new 
possibilities for improving instruction; these roles range from passive 

oional resource to simulated instructor. 

3. The responsiveness of the computer enables it to leach a process or’ 
dynamic system through interaction with a student. 

4. The diagnostic capability of the computer enhances individualization 
of instruction; enormous quantities of information can be exploited 
about the past and present performance of a particular student. 

Regarding the first point, several respondents remarked that there is a 
need for new authoring techniques and procedures. It has of course proved 
necessary with any new medium (from the book through movies to tele- 
vision) to develop new production techniques and to train the necessary 
personnel; large-scale course development for CAI is certainly no cxccp- 
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lion, Sonic of the programming, display, ami documentation techniques 
require the solution of problems that have not been encountered with the 
older media. This point should not be undcrempliasized. Many current 
applications of the computer in education have either been pedestrian or 
superfluous - i.c.. they could well have been accomplished through tradi- 
tional techniques or through relatively inexpensive, well -prepared pro* 
grammed texts. Users, therefore, have been unimpressed with the outcome 
of such experiments and have questioned the contribution of the effort, 
especially in view of die considerable expenses involved. Tims. CAI dcvel* 
opers should be engaged in more frontier work and less in gimmickry and 
should be concentrating on developing new methods for producing 
materials. 

With respect to the second point, it is important to explore and develop 
the full range of CAI techniques*** (Item 2, Table 5). A CAI program is 
qualitatively quite different from a book, film, or television, in flexibility 
of adaptation to virtually any kind of instructional role. It can combine 
content and process with evaluation, decision making, and record keeping. 

It is potentially lest, text, teacher, remedial specialist, audiovisual special- 
ist. guidance counselor, and administrator wrapped into one coherent 
system. This qualitative difference raises conceptual and technological 
questions not met in other technology-based educational aids. For in- 
stance, it must be decided what techniques arc suited for different ages, 
and what orientations are most beneficial for the student in the long run. 
One minority view related to this point is that computing is becoming a 
basic skill, on the order of reading and writing, Education should teach 
this skill so that the student himself can access the vast store of infor- 
mation available in an appropriate educational information system, and 
find his own answers, "It would be a shame if we denied the student die 
competence to use the computer as an intellectual resource. We are turning ~ 
out technologically unemployable people in the future if we deny This 
really elementary kind of skill. Computing is a technique that ought to be 
shared with the student, as opposed to being used merely to carry' out the 
teaching. It should be the thing taught.” 

A third unique aspect of the computer, that arises from its enormous 
in format ion-handling capacity, is the potential to simulate dynamic sys- 
tems. The student can interact with such a system, receiving immediate 
feedback on the appropriateness of his inputs, in situations where it would 
be impossible to have such free play in the real system, because of physical 
and practical constraints. Examples range from running an experiment in 
nuclear physics, to flying a jet, to managing an economy according to a 
given model. In line with this sort of structured interaction or game, in 
which the student learns the system instead of facts about the system, the 
computer has 'a' significant potential for teaching information processing 
and the associated problem-solving skills. This is, in a sense, a kind of 
content-neutral or content-independent notion of instruction, which might 
be advantageously used in teaching students how to make the kinds of 
decisions they actually have to make when selecting tlicir own learning 
sequence. Decision-making abilities in terms of processing information ef- 
fectively arc not part of the usual set of skills specifically developed by 
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traditional instructional methods. The use ot C’AI lor process teaching -- 
i.e.. through simulation and gaining - was thus considered a primary con- 
tribution that the computer could make to education (see Item I. Table 
-)• Simulation and gaming were judged to be forms of CAI that would also 
elicit a substantial market and thus should be developed much more 
extensively.*** 

The fourth point involves the fact that the computer has an almost 
infinite capacity to take into simultaneous account enormous numbers of 
tacts about a student - his knowledge, ability, preferred learning patterns, 
etc. The computer can use this information, in what could be a powerfully 
effective way. to select from vast numbers of alternatives tltc next instruc- 
tional goal or testing item most appropriate to the individual student. 
I lowcvcr, our present understanding of individual differences and our pres- 
ent capacity to identify them and respond with differentiated instruc- 
tional sequences arc many orders of magnitude less than needed tocxploit 
this capacity of the computer. We arc not yet in a position to take real 
advantage of this potential, even though the individualization of sequences 
is commonly regarded as one of the attributes of CAI that can make it 
exceptionally effective in instruction. Consequently, there is urgent need 
for extensive research in a) testing techniques able to make fine discrimina- 
tions of achievements, potentials, response patterns, learning patterns, etc.: 
b) the development of tlicoric? regarding the underlying relationships 
among these variables; and c) tlte development of pedagogical tedtniques 
and sequences ot materials responsive to the individual patterns.** 
Research Use 

It may be that the computer itself will provide a basis for tltc develop- 
ment ot learning theories. Tlte computer has unique capabilities for data 
collection and analysis during instructional use and for virtually instan- 
taneous updating and improvement. More significance should be attached 
to the tact that CAI can be used in a research mode, uniquely, to gather 
information about learning.* Through this important capability, we can 
acquire greater experience with student use of computer material and thus 
can continually modify it. Only such experience can teach us what com- 
puter techniques and material are educationally sound. In this regard, 
there was strong agreement that CAI both affords and necessitates a re- 
search and development effort to study the comparative effect of instruc- 
tional strategics, and the theoretical and measurement problems involved. 
This would lead to continued refinement and eventual good achievement 
rather than overnight success. It would also be useful to do studies of 
CAI s potential for reducing the cost of developing materials, in addition 
to increasing their quality. 

Learner Control 

Learner control was recognized by many to be a very important al- 
though little explored dimension of CAI research. Several attitudes under- 
lie this issue: 

1) The computer ought to be used more as an intellectual resource 
controlled by the student. 

2) The concept of learner control focuses on teaching tltc student to 
judge appropriate strategies for obtaining and using infomtation 
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- a critical educational function in itself and a uniquely appro- 
priate task for the computer. 

3) Learner control represents the most direct approacli to individual- 
ization, effective to the extent that the student can judge what 
works best for him. 

Several participants, however, expressed doubt about the practicality of 
relinquishing to students effective control of their learning sequences.* At 
the most basic level, one respondent pointed out, we need more data to 
show that learners can control their learning more efficiently than some- 
one else. Data at present do not unequivocally support (his position. It was 
also suggested (hat learner control will be a very difficult and expensive 
option to achieve in CAI systems and should therefore be tackled only at a 
much later stage. A final point was that learner control studies need to be 
designed with sufficient numbers of options, in order to evaluate the true 
impact of learner control. That is, studies should provide options for learn- 
ing which include no use of the computer along with options in subgoals, 
in content, and in sequencing the materials. 



D. Educational System and the Teacher 

A broad use of CAI will require a change in the established patterns of 
instruction and a restructuring of the traditional role of the teacher, par- 
ticularly at the precollegc level. It will also eventually entail more rigorous 
analysis of cost effectiveness, specification of goals, and measurement of 
instructional efficacy. These will follow from the inevitable application of 
CAI to management and research modes as schools grow familiar with the 
computer’s information-processing capabilities, and these applications will 
serve to provide a basis for systematic improvement of educational 
methods. A number of problems have been encountered or arc anticipated, 
as indicated in Table 6. 

There was agreement among participants that more information and 
training programs arc needed, to counter the lack of knowledge and prej- 
udice of teachers and administrators with regard to the computer. Diver- 
gent viewpoints were expressed as to the role of teachers in aiding imple- 
mentation and creating materials for CAI: some felt (hat teachers’ interest 
and potential con * r *bufion would be high, while others sharply disagreed. 
Additional issues which received discussion - and which arc summarized 
m the remainder of this section - were evaluation and documentation 
computer-managed instruction (CMI) and the need for major revision of 



School Resistance 

A number of reasons were suggested for the apparent resistance to CAI 
of the precollcge educational system. They included: 

1) the high cost of computer systems, and the related problems of 
measuring their cost-effectiveness and justifying the expenditures to 
the public; 

2) the fear of change, especially when it results from a technology as 
complex as the computer. There is also the expectation that the 
computer will be another in a senes of much-touted technological 
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educational system and t/ie teacher. Responses in this cate- 
gory related to problems underlying the need to change estab- 
lished patterns ot instruction and to restructure the role of the 
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1. Reluctance ot school personnel to go through reorganization and training that 

a broad use of CAI would entail . 








M 




2. Cautiousness and uncertainty on part of educators os to effectiveness of CAI 

in comparison with traditional teaching methods. 








M 




3. Scarcity of resources available to tram teachers and others in the skills 

required to use CAI successfully. 






M 






4. Fear of educators ot being reduced to a "button-pushing" or clerical role by 

computer. 






M 






5. Reservations os to possible negative effects of removing instructional process 

fromsocidl situation ond replacing interpersonal feedback with mechanical. 






M 






6. Extreme diversity of, and lack of coordination among, school systems 

throughout the country. 






M 






7. A prevailing attitude that the computer will be used to replace poor teachers 

instead of to make good teachers more effective. 




M 








8. Insufficiency of evaluative techniques, criteria, and agencies with which to 

satisfy educational standards. 




M 








9. Not enough opportunity for local school people to participate in development 

of CAI programs. 
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tools that have for various reasons failed to live up to initial promises 
(radio, TV, language labs, programmed instruction devices, etc.); 

3) the ignorance of the computer’s potential, limitations, and adapt- 
ability - factors to be resolved only by teacher training; and, 

4) the clash of values, arising from the teacher’s feeling that the com- 
puter will deprive him of highly valued personal relationships with 
students. 

One participant suggested that presenting fully developed programs, that 
utilize the teacher only in a minimal way, has contributed to the teacher’s 
doubt and antagonism. 

These problems are probably more severe at the lower academic levels, 
where computers may be used to augment or replace a relatively large 
portion of a teacher’s total activity. At the university level the instructor 
will suffer little threat to his professional self-esteem; he can became in- 
volved in developing programs himself, and thus is a potential advocate, 
not a resistor. There will also be clear rewards to the community college 
teacher, since the computer does not threaten his role; rather, it offers 
hope of dealing with problems the faculty would prefer to escape. 

Further aggravating teacher resistance is the present ovcrsupply of trained 
teachers. For CAI to be cost-effective at this time it probably wili have 
to produce some reduction in teaching staffs, in favor of greater use of 
paraprofcssionals. That reduction might be slight, and perhaps could be 
satisfied by the attrition that normally takes place in schools. But any 



substantia) staff reductions needed in the interests of cost effectiveness 
would be difficult or impossible to obtain at present, particularly now that 
so many teachers arc unionized. 

One conferee asserted that the issue of staff reduction has resulted in 
unfortunate kinds of pressures on school boards, the crucial element in 
school systems. ‘‘The public is told that CAI can reduce costs; at the same 
time it is told that, because you have to think about the teachers* union, 
CAI will not replace teachers. Now, everyone knows that if you arc not 
replacing teachers, you arc not only not reducing costs, you arc adding to 
costs. Because there hasn’t really been an honest dialogue on this, the 
people who eventually have to make the decision whether there should be 
money spent on CAI - the school boards — arc not very receptive.” 

Teacher Involvement 

There was a wide divergence of opinion among participants with regard 
to the importance of teacher involvement in introducing CAI to educa- 
tional systems. A few comments were veiy negative in assessing the com- 
petence or interest of teachers in implementing educational improvement. 
For instance, “If released to meddle more profoundly in the student's 
intellectual development, they would probably do more harm than good.” 

The more prevalent view was that teachers, particularly at the pre- 
college level, arc locked into traditional teaching styles by lack of training, 
free time, or rewards, and that they would, if freed from these constraints, 
be open to and actively interested in innovations that were demonstrable 
improvements over traditional techniques, and would have much to contrib- 
ute. It was remarked that a teacher who has been exposed to and con- 
vinced of CAPs value makes its most effective proponent. The conferees 
described several instances of teachers becoming enthusiastic about CAI, 
independently of any sales pitch or external pressure, simply because it 
visibly met a concrete need. For example, “. ..Some years ago I had a 
fellow come and explain how he was using a table of random numbers to 
generate all the forms of a test to a group of teachers of low achievers. 
These teachers are veiy receptive because we’ve tried a lot of things that 
we know arc not working. And so he said, ‘Well, really, if I wanted to 
generate more than five test items I could do it on a computer.' And the 
teachers right away said, ‘That’s great!’ Now, this was a realistic possi- 
bility, to get one terminal in the building. So they started looking, and as a 
matter of fact we did get a manufacturer to develop the thing and let us 

use it free for a couple of years. This is where we got started I’d say 

by this year probably half our secondary students will have written and 
run a couple of BASIC programs. The teachers arc very receptive, very 
positive to this because it’s coming in as something that helps them; it’s 
something they have a vested interest in. ...” 



Another example was offered by a university professor: “If teachers see 
materials, if you can somehow force them to look at materials, if they turn 
out to be extremely relevant to their needs, they see it very quickly. We 

had an experience a couple of weeks ago with a colleague of mine He 

came in asking what sort of equipment we had around for demonstrating 
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motion, and we told him about a simulation that lets you look at almost 
any aspect of motion on a graphic terminal. He was very negative; he said 
no. no, he didn’t want any damn computers and he didn’t want the 
students to program - the typical kind of response. Well, in the course of 
showing him other things, we sort of dragged him up to the terminal. Ten 
minutes later the story was exactly the opposite; now our problem is that 
we only own two of these graphic terminals. And it’s simply because tlicrc 
was something that filled in with his needs in the course, and he saw this 
even though he was very negative.” 

Teacher Training 

The education of teachers in CA1 techniques is a prerequisite to full 
acceptance of computer use in education.** Very little progress is likely to 
be made until teacher-training institutions enter CAI in depth. Their ef- 
forts would have to include practical training in the use of the hardware, 
the understanding of the software, and the techniques of integrating CAI 
with the traditional educational process. Without this background training. 
CAl applications will not be wholly successful - the new techniques will 
only be used to replicate traditional classroom practice. 

In addition to providing useful techniques, proper training would effec- 
tively counter the misunderstandings as to the purposes and limitations of 
CAI which have led to prejudices and biases against it. Many teachers arc 
confused about its potential and object to its use as dehumanized or 
mechanical. Others arc apprelicnsive that the computer will replace them 
or reduce the importance of their role. When these concerns arc combined 
with the prejudice in favor of the print media, the result is a significant 
force for maintaining the status quo. However, if more of tltc professional 
training of teachers is directed toward the understanding of CAI, current 
biases will tend to dissipate. 

Teacher Control 

One way to ensure that teachers arc com fo/ table with CAI systems is to 
design systems that arc aids to, or arc controlled by, the teachers. Not 
everyone agreed, however, that this was a good way to gain teacher accep- 
tance; the concept of "control” was especially attacked in this context. 

”1 think if yon talk about teacher control, you’re reinforcing one of the 
worst kinds of stereotypes, and that’s the one thing we’ve got to destroy: 
that there’s somebody who teaches people and that the teacher controls 
the situation, the teacher’s in charge. We should try to get that teacher to 
change that role — not to be up in front of the room, but rather to be 
assisting, tutoring if you like, but getting out of that role of being in 
control of that classroom.” In short, the opposing view held that it is 
precisely the teacher’s traditional control that education should begetting 
away from. The suggestion was that there should be a change in educa- 
tional philosophy which would result in the teacher’s role being one of 
guidance and assistance, rather than control. 

Local vs. Professional Development 

Curriculum development by local teachers rather than by professionals 
was judged to be an issue of moderate importance. While some participants 
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felt that major program development could be centered in the schools, the 
majority doubted that this was practical. One school administrator did 
point to several successful programs that teachers in his system had inde- 
pendently created to meet certain needs. Most participants, however, felt 
that the main effort of development must be undertaken as a full-time 
professional job, and that good CAI materials arc so expensive to prepare 
that producing them will have to be done under centralized auspices. They 
added, however, that teachers should be provided an opportunity to con- 
tribute to and modify program material, possibly to the extent that leaves 
of absence should be arranged for selected teachers to permit their par- 
ticipation in program development outside their schools. If teachers arc to 
prepare effective programs, they must, of course, develop the special com- 
petencies required to design, write, test, and revise instructional packages. 

The extent of interest in local versus professional development will vary 
as a function of educational level. At the higher educational level, one 
should expect intense interest in local determination of course content; no 
professor at a major university is likely to consider himself less competent 
to design curricula than any of his colleagues, nor will he ever agree entire- 
ly with a curriculum prepared by somebody else. At the secondary and 
elementary levels, however, less intense personal concern may be expected, 
since these teachers are typically more willing to use without modification 
curricula prepared by others. 

Course Objectives 

The lack of clear-cut course objectives was considered to be a notable 
obstacle to developing truly effective CAI programs and to comparing CAI 
with conventional teaching methods.** This absence of objectives was also 
seen as a general educational problem. One participant pointed out that 
most students and many teachers are likely to be confused about tin? 
objectives of a given course and, about what the end product is supposed 
to be. One of the most valuable side effects of the CAI approach is that it 
forces educators to pay attention to careful definition of course objectives. 
Thus, CAI benefits instruction by explicitly exposing ignorance of the 
learning process. It forces decisions about teaching programs that arc 
usually not made because the need for them is not apparent. 

CMI 

Some mention was made of the value of computer-managed instruction 
particularly in reducing costs and gaining acceptance for the computer 
through demonstrating its practical utility.* One conferee offered the 
opinion that CAI will come into being in schools when capital costs arc 
covered through introducing computer information systems for manage- 
ment purposes. Another view was that management use of the computer 
would be an intrinsic part of moving toward a more technology-based 
educational system. 

Educational Revision 

A few respondents were pessimistic about the adoption of CAI without 
major redesign of present school systems to accommodate it: “! believe 
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th;it C A I will not have broad educational application in elementary and 
high schools for a very long time, if ever. CAl represents a major com- 
mitment to a new technology and a new threat to the status quo. School 
systems do not have the necessary organizational behavior and manage- 
ment skill to handle such a threat. As they arc now organized, staffed, and 
financed, there is no payoff for change. . . 

It was suggested that the effort to advance CAl should be one part of a 
large-scale clfort to update the educational system, with careful coordina- 
tion of development and adequate funding: “The successful use of com- 
puters in education is dependent upon a major substantive revision of the 
conventional educational process.” Such a revision is a systems design 
problem, is extremely costly, and is beyond the financial capability of any 
single educational entity. The design, test, and evaluation of an effective, 
practical, and economically' viable educational system would best be 
financed by the federal government and approached with the same com- 
mitment as (a favorite analogy) the project for landing a man on the 
moon. Such a program will automatically require the use and acceptance 
ot the computer and associated systems in education. 



Evaluation and Documentation 

There was agreement that evaluation of CAl systems is important to the 
ultimate acceptance of computers in the educational process.* There need 
to be detailed evaluation studies providing school administrators with the 
justification lot introducing new capital-intensive equipment and tech- 
niques. 1*. valuation must show time cficctivcncss, and cost effectiveness 
comparable or superior to present results. It is critical to show that the 
computer can overcome some difficult instructionafproblcms that current- 
ly exist. If CAl developers can present school superintendents or school 
boards with evidence from an independent auditor indicating significantly 
better achievement with CAl than with other methods, the ultimate ac- 
ceptance of CAl will be greatly facilitated. In this regard, several partic- 
ipants emphasized that the present reluctance to invest in CAl is not due 
to tear or lack of interest, but to not having sufficient evidence that CAl 
represents educational improvement. There have not, they alleged, been 
many persuasive repurts of CATs value in education. In addition to careful 
evaluation, there should be intelligent, honest., critical reviews of the re- 
sults of demonstrations, well written, interesting, and widely disseminated. 

The documentation and validation of current instructional programs is 
also an important need. This area shares with evaluation the problem of 
devising appropriate standards against which instructional success can be 
measured aud of creating effective organizational structures. Documenta- 
tion as well as evaluation will require some degree of formal organization 
and financing. No agency has been established to do the job, and personnel 
who could carry it out effectively are scarce. 

One participant held the view that once a market is established, evalua- 
tion will take care of itself. That is. the better materials will naturally be 
those which arc most popular and in greatest demand. However, the more 
widely held attitude was that the educational market is not, nor should it 
have to be, sophisticated enough to effectively judge the worth of CAl 
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systems, in which public funds must be invested. An extensive and care- 
fully planned experimental design is required to prove actual benefits in 
relation to cost; hence evaluation must be systematic and professional. 

In connection with evaluation, a participant noted that one must also 
consider alternative, and less expensive, means of presenting the same 
material and activities. Clearly much of the drill and practice can be ac- 
complished in other ways: perhaps a teletype (or talking typewriter) could 
be replaced by a programmed text and a guide for a paraprofossional 
working with the student at an electric typewriter; much of the exposikuy 
materials could be presented by slides or programmed texts, etc. It is 
important to look at these options because a primary concern of the 
evaluators will be to consider less expensive ways to achieve the same end. 

E. Cost 

This category grouped together problems related to the cost effective- 
ness of computer-based instruction. Two central issues were identified. 
First. CAI is an add-on cost that docs not reduce the instructional budget 
- in fact, it increases the personnel budget by the addition of required 
programming support. Second, even where good cost effectiveness can be 
achieved over the long run, the high initial capital investment makes imple- 
menting CAI prohibitive. Table 7 shows the specific items and responses 
relating to problems of cost that were judged to be important. 



TABLE 7 

Cost. Responses in this category dealt with problems ol cost* 
effectiveness of computer*based instruction. 
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1. Fact that CAI is an add-on cost, not reducing instructional budget, and 

requiring additional programming pciSOnnel. 
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2. High capital investment even where good cost -effectiveness can be achieved in 

the long run. 
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3. Poor cost-effectiveness, to daie. of computerised instruction. 
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Nature of Cost Problems 

In general, the problem of cost was considered to be an important 
obstacle to computer acceptance, but not necessarily one to which great 
effort should be directed at this time.*** As one respondent wrote. “In 
spite of the fact that sheer cost of computing has most limited the wide- 
spread use of computers in instruction, i do not recommend more empha- 
sis on this area than already exists. Education is not likely to force 
computing costs downward any more rapidly than other markets for 
computers are now forcing costs downward. Therefore, education would 
be better advised to concentrate on unique needs in computing hardware 
and software and simply to wait out die cost problem. 11 Other respondents 
felt that by the time materials are organized for a computer-assisted 
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medium of instruction, and schools properly funded and administered in a 
way permitting CAI to be tried, the cost problem will have been solved by 
agencies outside of the schools.* Industry, business, and government 
bureaus have already installed large networks of remote terminals for their 
own purposes, and their coming into use for instructional ends is only a 
matter of time. To the business or industrial user, the high effectiveness of 
instructional technology can be translated into terms that arc easy to 
evaluate, namely, economic terms. Thus it is these users* requirements that 
will probably accomplish more than any additional efforts to bringdown 
costs on behalf of educational institutions. In short, the majority opinion 
was that educators should not at this stage be especially concerned with 
cost. By the time CAI is truly ready for widespread use in instruction, the 
cost factors may be entirely altered. 

Cost Effectiveness 

A substantial problem in solving the issue of cost is the difficulty of 
measuring cost effectiveness in educational systems, where goals are usual- 
ly inadequately defined.** Schools traditionally have not seen it as their 
responsibility to examine and specify instructional objectives. Where ob- 
jectives do exist, as for example in the military and some areas of industry, 
CAI seems to be very cost effective and the use of programmed instruc- 
tion, by means of computers and other media, has grown steadily. 

As an example of the problems to be encountered in cost effectiveness 
measurement, one participant pointed out that “The largest cost factor in 
instruction is the teacher’s salary, but the time that many current CAI 
systems would ‘save’ would be the 10 hours, approximately, the teacher 
contributes after school (lesson plans, test preparation, grading, etc.), time 
which represents a ‘free’ resource traditionally contributed by the teacher 
to the school. Thus, the notion of effectiveness implied in the concept of 
‘cost effectiveness’ is foreign to current school operation.” 

Several participants noted that one of the most beneficial effects of 
CAI .{hat it will require a clearer specification of educational objectives. 
All s&ktols, at least implicitly, do have objectives and, in every budget, do 
make cost effectiveness judgments about their attainment. But they do not 
define the objectives clearly nor quantify them adequately. The result is 
that the judgments as to cost effectiveness are usually ill-formed or unreli- 
able, Consequently, schools do not have sufficient incentive to increase 
effectiveness* because there is no systematic feedback indicating the 
school’s performance in achieving instructional goals. 

Inappropriate A ccounting Methods 

In the view of several respondents, elementary and secondary school 
staffs tend to be prejudiced against CAI, because they feel that the high 
cost per student hour of CAI cannot justify its replacing traditional teach- 
ing methods. Clearly, since cost effectiveness is a significant issue in the 
acceptance of computers in instruction, there will have to be careful analy- 
sis of existing costs, at all levels and for different subject matter, in order 
to establish a baseline for comparison. However, there are obstacles to 
such a comparison. The current budgeting practices of public school sys- 
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icms do nol lake accounl of Hie increased speed al which CAl-laughl 
students may reach course objcclives, nor do they recognize that CA1 may 
nol simply replace traditional techniques; instead, it may provide a higher 
quality of educational product than achieved in conventional instruction. 
These problems in comparing instructional methods arc exacerbated by 
the inability of most schools and colleges to measure the cost or 
effectiveness of conventional instruction. As one participant noted. 'There 
is a general failure to understand the systems nature of the educational 
problem and therefore a failure to understand the true costs - direct 
indirect, and social - of education or lack thereof.” 

Cost Factors — College and Precollege 

If cost problems are to be attacked by the educational community, 
they will, for a number of reasons, be more readily resolved at the college 
level.** First of all, the ability to pay obviously differs widely with level in 
terms of the observed expenditures, per student hour, for education There 
are fewer restrictions on institutions of higher education in allocating 
funds and reordering budget priorities than there arc in elementary and 
secondary schools. The elementary school budget cycle is geared to 
meeting annual operating costs that cover, for the most part, teachers’ 
salaries, plant operations, debt retirement, etc. Any heavy capital invest- 
ment, requiring amortization over a prolonged period, is hard to finance 
under current funding practices. Also, it is difficult to reschedule school 
expenditures to take account of capital and operating costs when savings 
cannot be directly counted. Finally, computer resources, in terms of hard- 
ware, personnel, and access to shared time in underutilized central com- 
puters, arc much more likely to be present at universities. 

F. Technical Research and Development 

Categ0ry com P r * scs problems relating to the technological side of 
C AI development. It was generally agreed that not enough has been done 
1 rr ^ C * es *8 n * n terms of perfecting appropriate hardware, and that more 
effort needs to be put into creating effective, specialized, flexible equip- 
ment. One point of dispute was the importance of natural language pro- 
cessing as a critical technical capacity that must eventually be developed in 

CAI, different concepts of CAI’s ultimate role were reflected in this dis- 
agreement. 

Table 8 lists specific factors in this category that were rated in the 
questionnaire sequence. 

Hardware Systems 

Several issues in the area of research were identified as moderately 
important to CAI acceptance. One research issue is the need for improve- 
ment in the available CAI hardware systems.** One major criticism, which 
underlies Items 1, 2, 4, and 5 in Table 8, is that current hardware is not 
appropriate to educational use. At the level of the man/machine interface 
there is need for education oriented terminals. Present computer terminals 
are designed for business, not education. They arc often noisy and unpleas- 
ant to use, and in many cases they do not supply the response options 
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(hat arc critical to selection or instructional sequences. 

Terminal design was the most frequently cited problem of current hard- 
ware systems. Particular terminal capabilities identified as being important 
for education were these: 

1) a high volume random-access audio unit for use in teaching reading 
and languages; 

2) a vidco-casscttc attachment for use in presenting fixed information 
under computer control; and 

3) a display capability that includes the use of light pen and the abili :y 
to produce hard-copy output. 

The consensus was that in the area of technology, terminal engineering is 
far behind central-processor engineering. Intensive development could pro- 
duce terminals that are inexpensive, reliable, and fast; it should also pro- 
vide the capabilities described above. 

Another problem rises from the experimental nature of most current 
CAI programs. Much CAI experimentation has been conducted on large- 
scale computers developed for general-purpose time-sharing in business, 
industry, and science. These large-scale configurations impose program- 
ming-sysicms constraints that arc subject to many levels of complexity and 
frequently lead to problems of unreliability. It is unlikely that mass dis- 
semination can come about with these systems. Therefore, further devel- 
opment of systems must be engineered that provide the computer logic 
and architecture appropriate to the primarily nonnumcric processing de- 
mands of CAL 
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Natural Language Processor 

One issue, on which there was substantial division of opinion, was the 
need for natural language processing capability and greater in-depth ex- 
ploration of artificial intelligence techniques (Item 3. Table 8). One group 
felt strongly that the ultimate success and acceptance of computers in the 
instructional process would depend to a large extent on the computer's 
capability for natural language processing. It was their contention that the 
limitations on student input imposed by the inability of the computer to 
accept frec-form responses (or questions) were a critical impediment to 
widespread computer use. The point of view of the advocates of natural 
language processing was well represented by one participant, who noted 
that “for complete mastery of a concept, the student should be able to 
explain the concept in his own words, compare it with related concepts, 
correct a mistake in judgment about the concept, and so forth. These are 
the kinds of responses we use to judge whether or not someone under- 
stands a concept. And CAI systems will have to be able to accept and 
interpret such inputs, if CAI is eventually to play a significant role in 
education.” On tlic other hand, those who did not favor continued re- 
search in the area of natural language processing pointed to the success of 
programmed instruction and contended that CAI can realistically teach 
any subject or concept when programs arc developed with ingenuity. It 
was their contention that it is a waste to try to remake the computer to do 
something for which it is ill-adapted or totally unadapted, when there exist 
so many things that the computer can do superlatively well. An analogy 
would be to criticize a book's inability to reproduce sound as making it 
ill-adapted to teach music or speech, and recommending development of 
an audio function for books, ignoring the fact that tlwrc arc already tapes 
and records at hand that carry out that function. 

Programming languages 

The suggested need for new and more appropriate CAI programming 
languages was considered relatively unimportant (Item 6, Table 8). A 
number of respondents commented that many such languages now exist, 
but do not seem to be of particular use. For the most part. CAI program- 
ming languages arc trivial and do not treat the full range of problems 
encountered in preparation and debugging. Consequently, general-purpose 
languages, for facilities designed for particular tasks, are more often appro- 
priate and useful. Many respondents felt that the proper production of 
CAI materials would best be accomplished by an author working solely on 
analysis and representation and supported by a technical team to carry out 
the programming. Hence, there would be no need for a simple author 
language. 



Chapter V 



Conclusions and Recommendations 



The problems of CAI acceptance and use arc numerous and complex. 
As noted earlier, they have three major dimensions - educational, eco- 
nomic, and technical — that are reflected in the six categories of problems 
discussed above. The educational dimension, relating to the availability of 
adequate materials and the lack of evidence of CAI effectiveness, was 
judged to be the most critical. The second most critical dimension is 
economic. However, while recognizing that economic factors arc signifi- 
cant and pervasive, the study group felt that the problem of high costs 
would be alleviated by ordujjry market pressures to bring computing costs 
down. Finally, the technical dimension, which is mainly concerned with 
creating adequate CAI delivery systems, was judged not to be of critical 
importance in comparison with the sizable economic and educational 
problems. 

In approaching the overall problem of CAI acceptance and use, it is 
helpful to recognize the existing circularity of the analyses. For example, 
the major educational question “How can evidence of effectiveness be 
provided?” evokes the following sequence of answers: To provide evidence 
of effectiveness, one must (a) conduct a convincing high-quality demon- 
stration. But (b) to conduct a proper demonstration, one needs good 
computer-based materials. But (c) to develop good materials, one needs 
good people who know theories and methods of instruction and are sensi- 
tive to the role of the teacher and problems of the classroom. But (d) to 
get good people, one needs professional recognition and economic incen- 
tives. But (e) to get professional recognition, one needs evidence of the 
value of the pursuit (see point a) and to get proper economic incentives 
one needs a formal production-distribution system (as in textbook publish- 
ing) and an active market. But (f) to establish a production-distribution 
system and market, one needs a demonstration of effectiveness to con- 
vince potential investors and buyers of CAI’s value - and we are back at 
the beginning. 

This circularity suggests that, theoretically, an infusion of funds at any 
one of these steps might advance overall development by reversing the 
cycle. It also indicates that a large-scale program of funding would have to 
take these interdependencies into account. For example, drawing on 
recommendations outlined in Tables 9 and 10 and the original action plans 



TABLE 9 



Action statements suggested by the conference attendees to 
be promising means for enhancing a more widespread use of 
computers in instruction. 

1. Simulation and gaming. Concentrate curriculum development efforts 
on utilization of the computer's unique capabilities, c.g., in problem- 
solving exercises, simulation, and gaming. 

2. Learner control/learning styles. Develop systems that allow more 
learner control of tlic material and of the style of teaching. 

3. Educational terminal (graphics/audio). Organize a team of indus trial 
designers, engineers, teachers, and students to develop one o; several 
educationally oriented computer terminals. 

4. Learning theories. Develop a foundation of theories of learning and 
experimental data which would enable the computer to be maximally 
flexible and effective in teaching, as opposed to being a page turning 
and response recording device. 

5. Support teachers in CAI development Identify teachers who are good 
writers and who have classroom experience in computer applications 
and support them in the writing, publishing, and distribution of 
quality curricular materials. 

6. Summer workshops » Institute summer workshops to provide teachers 
with hands-on experience with available CAI systems. 

7. Software format. Establish a format for the production of software 
that will make it usable in a variety of hardware systems, 

8. Cooperative/competitive. Develop programs in which the student 
questions the computer rather than the reverse (cooperative ratlwr 
than competitive use of the computer in a learning situation). 

9. Model town. Set up a large-scale model demonstration of CAI-in-the- 
home in a new town (200 new towns arc now in some stage of 
planning or construction in the U.S.). 

10. Model schools. Set up one or more CAI -based model schools (ele- 
mentary schools, high schools, or college campuses). 

11. Cooperative project. Implement a cooperative project involving a com- 
munity college system and a major commercial producer of educa- 
tional materials to develop, test, and demonstrate a remedial course, 
such as remedial English. 

12. Large-scale demo. Mount a large-scale experiment to demonstrate the 
economic feasibility of CAI. 

13. Finance teaching of CAI techniques. Finance teacher training institu- 
tions to include practical training in the use of hardware and software, 
and in the techniques of integrating CAf with the traditional educa- 
tion process, 

14. Learning styles , Develop the capability to identify and match student 
learning styles in different content areas with appropriate pedagogical 
techniques. 

15. Professional incentives. Establish professional incentives for university 
facility through a grant program that requires from the recipient 
university assurance that work on CAf development would be judged 
equivalent to research, in terms of promotion, salary, etc. 
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TABLE 10 



The fifteen recommended action plant at tuqgrtted direc 
liont lot bttaking the ttatut quo cycle. 



Learnet Conuol/Lear ning Stylet 

Educational Teimmal (Graphics/ Audio I 

Learning Theoriet 

Coopeiative /Competitive 

Learning Stylet 

Simulation and Gaming 

Support Teacheit in CAI Development 

Cooperative Protect 

Profettronal Incrntivet 




LACK OF 

DEMONSTRATION 



LACK OF 

MASS MARKET AND 
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ill Appendix 4, one might design a multi-level program of complementary 
rcscarch-and-action projects directed toward the teaching of remedial 
English. At the action level, the components of the program could include 
(I) a cooperative project to develop, test, and demonstrate course materi- 
als, and (2) witliin the context of the cooperative project, a provision to 
train and support teachers in the writing of course materials. The coopera- 
tive project could involve a community college system and a major com- 
mercial producer of educational materials, with professional collaboration 
of retained outside experts. The project would design the course, prepare 
the program and materials, including related conventional print and audio- 
visual materials, and test and refine them through two academic years. 
Concurrently, a laboratory could be established to train authors and sup- 
porting technical teams and to prepare faculty to use hardware and soft- 
ware in techniques of integrating CAI with traditional course materials. 

Research, suggested by Tables 9 and 10, that could feed into and refine 
the development of the course, and also capitalize on the availability of 
experimental resources, could include (I) a study to identify and match 
student learning styles with appropriate pedagogical techniques, and (2) a 
project to develop a more appropriate educational terminal. The study of 
learning styles would test the relative effectiveness of different pedagogical 
techniques (drill-and-practice, tutorial, problem-solving, etc.) in relation to 
the structure and complexity of the material being taught. At the same 
time, research could be undertaken to identify computer terminal features 
(c.g„ random-access audio capability for (caching reading and language 
skills, computer-controlled video capability, etc.) that might be particularly 
appropriate for educational applications. 

These examples are noted to show how a multi-level program of re- 
search and implementation might be directed toward overcoming the most 
critical obstanclcs to CAI acceptance, thereby gaining enough momentum to 
reverse the 'status quo cycle.’ Many other examples could be drawn based 
on the obstacles and probable resolutions identified by the project partic- 
ipants. The data base of opinion contained in this study should prove 
useful to CAI developers and funding agencies in setting research and 
funding policies likely to promote greater and more effective use of com- 
puters in instruction. 
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Appendix l 

The Questionnaires 

Following an* copievut Ihp lhn*f u«>d m the 

In%l ph4«* ot |hv mufy. 

EDUCOM 

INTERUNIVERSiTY COMMUNICATIONS COUNCIL. INC. 

MOM Off ico tloa 364. lluMNfoio Hood. Prmcolon. Now JofM/Otmo > Tolophono 60J 921.7575 



QUESTIONNAIRE 1 

Study of Factors that have Inhibited a More Widespread 
Use of Computers In the Instructional Process 



The potential of the computer In science and education has been widely 
recognized and is attested to by the growth of applications ir. these 
fields during the pact two decades. In certain areas, l.e., data 
analysis and research, considerable gains have been realized and many 
spectacular successes recorded. However, the computer is far from 
being accepted in one major area in education: use of the computer 
in the instructional process itself. There have been a number of 
successful experimental demonstrations of Its potential value, but 
the computer has yet to begin to be integrated within present 
instructional system#. 

The purpose of the project in which you are participating Is to 
identify those factors which have inhibited the widespread use of 
computers in the instructional process, and to suggest possible means 
for resolving these difficulties. 

Questionnaire 1, attached. Is the first of the sequence of three 
questionnaires which will be utilized in the study. It consists of 
four questions. The first, in two parts. Is posed In order to derive 
a working frame of reference aj to what the desirable outcomes and 
potential contributions are, or might be, from the introduction of computers 
into the instructional process. The second and third questions are the first 
step in the exploration of the difficulties encountered or anticipated in 
the realization of those outcomes. The last question will serve to indicate 
the extent and nature of each respondent’s experience in computer-assisted 
Instruction. 

It should be noted that, throughout the questionnaires, the term computer- 
assisted Instruction {CAI ) will be used as a generic term. It will not be 
limited to computer-programmed instruction but will be used to denote all 
aspects of the utilization of the computer In an Instructional context. 
Included within the scope of the term as used in this study will be what 
some have preferred to call computer-augmented instruction, computer-managed 
instruction, computer-based education, and also problem-solving, gaming, 
simulation, etc. 
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Question I 



IN WHAT WAYS DO YOU UELIEVE THAT THE USE OF COMPUTERS IS INSTRUCTION WOULD 
IMPROVE THE EDUCATIONAL PROCESS? 

(A) First estimate the desirability of each item as an 
educational improvement » using the checklist and the 
following scale: 

1 * not desirable 

2 m slightly desirable 

3 » moderately desirable 
U » very desirable 

5 ■ extremely desirable ' 



If you rat»> an item as ' 1 ' (not desirable) please 
make a note of the considerations on which you have 
based your ratings on the reverse side of this sheet. 







1 




3 


1* 


5 


1 . 


Would enable student to proceed at own rate* without pressure 
of "lockstepping”. 












2. 


Would provide instant feedback, with the result of more 
efficient learning. 












3. 


Would make possible immediately available records on stu- 
dent's learning history. 












U. 


Would enable student to select his own learning sequence. 












5. 

L 


Would provide more controlled learning environment; student 
not as subject to the negative influence of poor teaching. 












i 6. 
1 

! 


Would facilitate flexibility of learning program with regard 
to time and place; e.g., courses could be mode available in 
public libraries for working adults* or In homes. 












i 7. 
1 


Would rroe the teacher from the more routine* ”drill-and- 
practlee" aspects of teaching. 












! a. 
j 


Would free student to concentrate on mntcrial to be 
learned without pressure of competition from peers. 












o. 


Would help to Insure bias-free educational environments for 
minority groups. 












10. 


Would encourage a more freely questioning attitude by 
removing fear of making errors or asking inappropriate 
nutations. 












1 1 . 


w..tiM shirt Mu: ••mithnr.ta in student evaluation toward 
‘ilia! ament of objective learning criteria and away from 
placement in a normative "curve". 













Question 1 (cont'd) 



IN WHAT WAYS DO YOU BELIEVE THAT THE USE OF COMPUTERS IN INSTRUCTION WOULD 
IMPROVE THE EDUCATIONAL PROCESS? 

(B) A*; a second step, rate each item as to the 
computer* o potential contribution in effecting 
the improvement, using the fol loving categories: 

1 * would contribute nothing 

2 * would contribute little 

3 * would contribute moderately 

L * would contribute substantially 
5 * would contribute in a critically or 
extremely important way 

If you rate an ite.\ aA *1* (would contribute 
nothing) i please nake a ”ote of the considerations 
on which you have based y« ur rating, on the 
reverse side of this sheo. 



1. Would enable student to proceed at own rate, without pressure 
of "lockstepplng". 


1 


?. 


3 


U 


5 












2. Would provide Instant feedoack, with the result of more 
efficient learning. 












3. Would make possible immediately available records on stu- 
dent's learning history. 












i*. Would enable 3tudent to select his own learning sequence. 












5. Would provide m.*re controlled learning environment; student 
j not as subject to the negative Influence of poor teaching. 












f*. Would raeilltatf flexibility of learning program with regard . 
to tins" iuid flsce*. e.g. , courses could be made available in 
public libraries for working adults, or in homes. 












7, Wnulu rro*« the Irnchcr rrom the more routine, "drill-nnd- 
prieUco" >v:tM'Ctr. of teaching. 












M, Would free student to concentrate on material to be 
learned without pressure of competition from peers. 












9. Would help to insure bins- free educational environments for 
minority groups. 












10. Would encourage a more freely questioning attitude by 
removing fear of making errors or asking inappropriate 
questions. 












11. Would shift the emphasis in student evaluation toward 
attainment of objective learning criteria and away from 
placement In a normative "curve". 
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Question 11 



WHY HAVE COhPUTFPS NOT BECOME MORE WIDELY USED IN THE INSTRUCTIONAL PROCESS? 

Below are listed a number of suggested reasons. 

Please rate each in terms of importance, using 
the checklist and the following scale: 

1 » unimportant factor 

2 ■ slightly Important factor 

3 a moderately important factor 
*• * very important factor 

5 * extremely or critically important 
factor 

If yoj rate an item as '1* (unimportant factor), 
pleas* make a note of the considerations on which 
you have based your rating, on the reverse side of 
this sheet. 

Plena* add to the end oT the list any further 
possibilities, or restatements of items which you 
feel are unclear or inaccurate. 



1> Poor coat-ef fccti veness , to date, of computer-based 
instruction. 


1 


2 


3 


1* 


5 












2. High capital investment even where good cos t-e Tree tiveneso 
could Lc achieved in the long run. 












3. Lack of readily available computer-based educational 
materials. 










i 


Lack of carefully planned broad programs of CAI experi- 
mentation in actual school settings. 


1 










Extreme diversity of, and lack of coordination among, 
school jystemr, throughout the country. 












<«. tli*:ier vat 1 on:t mi to possible negative effects of removing 
instructional proc^un from social situation and replacing 
interpersonal feedback with mechanical. 












7. Inaufft eicney of evaluative techniques, criteria, and 
agencies with which to satisfy educational standards. 












8. Uncertainty as to who should distribute software and provide 
training and services for its users. 












9. Not enough opportunity for local school people to parti- 
cipate in development of CAI programs. 












10. Fear of educators of being reduced to a "button-pushing” 
or clerical role by computer. 
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Question II (cont'd) 

WHY HAVE COMPUTERS HOT BECOME MORE WIDELY USED IN THE INSTRUCTIONAL PROCESS? 



11. Cautiousness find uncertainty on part of educators as to 
effectiveness of CAI in comparison with traditional 
teaching methods. 



12. Lock of experimental data and theories in learning 
psychology which would facilitate the design of 
effective CAI programs appropriate to each age level. 



13. Llmi tat ions in the kind of student inputs interpretable 
by the computer. 



1L. Lack of professional and economic incentives for 
development of computer-based materials. 



15. Lack of incentivca for dissemination of software. 



1C. Lack of standardization of computer systems, limiting 
free exchange of software. 



17. Reluctance of school personnel to go through reorgani- 
zation and training that a broad use of CAI would 
entail. 



16. tack of a simple author language which would enable 
teachers to prepare effective programs without exten- 
sive training. 



19. tack of appropriate mechanisms for protecting patents, 
copyrights, etc. for CAI materials. 



?0. Lack of an organization to facilitate interchange of 
CAI program materials. 



21. tack of readily available hardware systems. 

22. Unreliability of hardware, in terms of frequent break - 
,|(twiis duo to heavy une by students and insufficient 
servicing. 



23, Dlusutiiifuetion with «lesign of presently availsb.le 
terminals. 




Ur 



Question II (cont'd) 

WHY HAVE C0KPU7KRS NOT BECOME MORE WIDELY USED IN THE INSTRUCTIONAL PROCfSSt 

Plcsac add nny additional items* or restatements 
of items which you feel sre unclear or inaccurate, 
in the space below* and rate then as you did the 
preceding items. Use additional sheets If you 
wish. 




Question III 

WHAT NEEDS TO BE DONE TO TAP MORE FULLY THE POTENTIAL CONTRIBUTION OF THE 
COMPUTER TO THE INSTRUCTIONAL PROCESS? 

List three or more areas in which additional effort 
would greatly facilitate the growth, in value and 
acceptance, of CAI in the future. Indicate, if 
possible, a time projection for the implementation 
of each suggestion. E.g., given an appropriate 
level of effort, would you expect implementation 
in the 1970‘s, 1980's, 1990‘s, 2000's or later? 

Listed on page 10 are three sample responses 
which illustrate the amount of detail requested. 

Use additional sheets if you wish. 





60 



Question III (cont # d) 

WHA? NEEDS TO »r DONE TO TAP MORE FULLY THE POTENTIAL CONTRIBUTION OK THE 
COMPUTER TO THE INSTRUCTIONAL PROCESS? 




O 
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i>AMIi>K HKiil’ONUJSIi FOR QUESTION III 

A. The incentives for writing textbooks are obvious and v c ll-dc fined, in 
terms of financial rewards, prestige, and enhancement of career. The 
incentives for writing CAI materials are not so clear; it would be a 
helpful step for government or private agencies to make financial incen- 
tives available, at least Initially, for potential writers of CAI programs. 
In line with this, provisions would have to be made for the safeguarding 
of copyrights. 



Courses in individually prescribed instruction and small-group tutoring 
should be provided in every school of education. Both courses Involve 
skills that will bo highly appropriate to teaching in a computer-based 
curriculum, while at the same time they would be of value in teaching in 
u conventional school situation. Consequently, schools would not feel 
they were making an irrevocable investment in CAI, while educators would 
nevertheless find it ouch easier to adapt to computer-based systems as 
a result of having a more appropriate background. 



Most estimates or the cost of student usage of present CAI systems involve 
figures many times greater than the corresponding cost per student In 
conventional schools. Computer-based materials should be able to compote 
.vonowl.nl ly with other learning media, i.e., books, blackboard, etc. 

T.j enmhut Mils problem there ought to he an extensive and coord Inn ted 
vn’.'rl. to bring down the coat, of CAI equipment by applied research. 

Posn i bly , in order to encourage the initial capital investments, there 
siliould U« a nubnidizution of the installation of CAI equipment in schools. 
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Question IV 



Briefly outline the areas In which you have experience in or knowledge of 
the une of computers in the instructional process, or experience in the 
Introduction of technological innovations to school environments in 
general. 
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Question IV (cont‘d) 

hi Md.HU oh, cheek each of the following categories in which you 

hnv«* hrul experience* 



1. Administration of CAI lab 
?. Administration of computer center 
3. Designing of software 
h. Software development 
Designing of hardware 

6. Hardware development 

7. Recordkeeping function of computer 

8. Design of computer-based curriculum 

9. Structuring of curriculum content 

10. Evaluating computer-based curricula 

11. Training educators in use of computer- 

based materials 

1?. Teaching with computer-based materials 



Signature Date 



o 
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INTERUNIVERSITY COMMUNICATIONS COUNCIL. INC. 

Poll Office Dor 364 * Rotedtl* Road. Princeton. Now Jaroay 00540 • T«*#pho«* 609-921-7575 



QUESTIONNAIRE 2 



Study of Factors that have Inhibited a Mere Widespread Use of 
Coaputers in the Instructional Process 



Thirty questionnaires were completed and returned in the first round of 
the Delphi sequence being used in this study. We have tabulated, con- 
solidated and edited the responses, ar.d the data ore presented for your 
consideration within this questionnaire-, which represents the second 
round of the sequence. 

Because of the number and length of the responses given in the thirty 
questionnaires, we have by necessity taken a fairly free hand in editing 
and deleting. It is hoped, however, that any gross error or insensitivity 
on our part will be pointed out in your responses. 

This second questionnaire consists of three parts.. The first part, 

Question I, was originally presented in order to derive a working frame 
of reference as to what the desirable outcomes and potential contributions 
are, or might be, from the introduction of coaputers into the instructional 
process. The eleven outcomes suggested were all given fairly high ratings, 
in terms of both desirability and importance of the computer's role in 
effecting the outcome. As this seen a a sufficient consensus for our purpose, 
we have simply tabulated the responaes and are asking for comments only 
where you disagree with the consensus, and for ratings on the three new 
items which were abstracted from the suggestions of a number of respondents. 

The second and third parts, Questions II and III, are closely related in 
that Question II asks 'what are the obstacles to the use of CAI' while 
Question III asks 'what needs to be done about them'. In this round we 
would like to begin to bring together explicitly the major obstacles that 
the group identifies and the action plans suggested to overcome them. 

Therefore, both responses to Question II and to Question III have been 
organized into seven groupings, or categories. For Question II we are 
asking for an assessment of the importance of the problems listed in each 
category. For Question III, the proposals for action, subsumed under the 
same seven categories, are presented for the group's evaluation and 
comments. 

As in Questionnaire 1, we would like to emphasize that the term computer- 
assisted instruction (CAI) will be used as a generic term, comprising all 
aspects of the utilization of the computer in an instructional context. 
Included within the scope of the term as used in this study will be what 
some have preferred to call computer-augmented instruction, computer- 
managed instruction, computer-based education, and also problem-solving, 
gaming, simulation, etc. 
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1» WUT «MS DO icy wtitvi that t*i ici c t cwovnw is isrnvcncji mu ncivit rut mxurosAi 
noctcst 



*n» rr»ro«»*» to Swittui I from the Tirol Questionnaire ltdtcal* o high deyr** 
or UMntHltr «f»tm reapoodcuia. r*t *r* io substantial i^rwei tbot tftr iL/^itioni 
(listed b*lj*) for using the coaput* r la Instruction arr on the whale highly 
desirable mi that la* computer's rola U lwtlfuwtlag these immltMi could b* 
a Hfiiritiat out. 

Rrcauo* of the high degree of accord we have slnply tabulated rfi^M to 
QuroltMi t lieu The data ar* a* tar graphs lndlcallrg. for eeery 

n*o. th* awaber of rripoo.fi la each category. They ar* ranked la order of tae 
arao response (aeeraged over A and >) . Him* retain* th* data and Indicate on 
tfc* revert* tide of lhl» sheet any disagreement you al«M bar* *ltb u* group rating, 

finally, pleas* rat* tb* last three liens. These ar* g 

a** U« suggested ty a number oT respondents la Question- Deal rabl Illy 

oalr* 1 a* being particularly l^ortaat and dea Iraki*. 



1. Mould provide Instant feedback, with tb* rvauil of rore sffl cleat 
la are lug. 



?. Mould enable student u proceed at ovn rata, without pressure or 
locks tepplad. 



J- **»!« facllltal* fleslbll 1 ty or learning progrm with regard u 
tla* and placet *.«•, couraea could k* asd* available la «*ilc 
libraries for work lag adults, or la bows. 



k. Mould b»« tb* t*acb*r fix 
aspects or IfKbtaf. 



i row tla* , dr!ll«and. practice 



5. McaUd aak* feasible laaedlstely available records on studeau* 
1 earn lag history, facilitating greater Individualisation. 



i. Mould encourage a aor* freely guest losing attitude by reaoetng 
fear of aakteg worn or ashing Inappropriate Questions . 



T. Mould help to insure liwfni educational nrlrtMtsu for 
alacrity groups. 



8. Mould shift the eaphaals lo student evaluation toward attain- 
amt of objective learning criteria aad way froa placewat la 



a noroatle* rarer. 



9- Mould pro* Id* a aor* controlled learning tnvl rawest i student 
not sa eukject to the negative lafluanc* of poor teaching. 



Would enable atwdent to select hi a own learning sequence. 



11. Mould rrr* stedent to eonrualrat* ca naterlal to be learned 
without pressure of coapellttoa from peers. 



lew Hess : 



1. Mould provide for sore highly Interactive interchange between 
student and body of subject natter whereby tb* student would 
Interrogate nod eiplore, rather than aaa lull ate lafornatloa froa 
a teacher. 



Mould enable students to work with p rob lean la system or realistic 
coaplestly; l.t., la sciences, business , engineering and wdtcla*. 



3. *«14 «nhe It possible *0r educational program to be aor* accurately 
and significantly evaluated, allowing systematic revision or course 
■at* rial to ortlnls* teaching efrectlveaes*. 
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WKT HAVE COKTUTOf. !K fS WTCHE M3« VlSIXT ICD I* THE DBTRUCTIOSAL PJCCEST 



X* e«n»o!l4iUd rtiponin fna Qwitlco II (m4 QmiiIoh III) Into th* 
«nrro ciu^rlci HiKd below; 



A. DOCRSTRA720I 
1. MSUK11 AID DCVELOFMEfT 
C. IICEITIVES/DXSTPlKffXOt 
V. DUCATIOIAL STSTSM3 AID 7KX TIACKEA 
I- aonvARE AID HARDWARE 

y. cost 

c. u-oximo* or cai 

Each category constats of th* original Items rated la Questionnaire 1 M 
well m e*w itraa suggested by reaper drat* in the first round. Aj la Question X, 
lien* rated In the first round are presented In rank order of l^ortance with 
tar graphs of th* frequency distributions or reapensea. 2 teas without frequency 
dl air! buttons art the new Iteas. 

Please rale both the old and the new Urea by checking the appropriate 
category, using the sane scale M la Questionnaire 1* 



1 • uni sport ant factor 

2 • slightly 1 sport ant factor 

3 • aoderately l^ortant factor 
A • very 1 sport ant factor 

5 • eitreaely or critically laportaat ractor 

Once agalo. please indicate oo th* reveree aid* of the sheet any 
dlasgreeeent you olght have with the group rating. 



A. DOC AST RATI OR 





1 


2 


3 1 




1. lack of carefully planned broad prograaa of CAI expert* 
aenl at ten in actual school aelllap. 










2 . Too few esaaples of high quality use, at least lo th* ryes 

or persona expert in the discipline and In teaching that disci- 
pline. Perhaps too aich attention to technology and not enough 
to substance. 








3. lack of eoapelllng evidence that CAI Is aore affective than 
other methods of coup arable cost. 












k. lack of "critical mass" In selling up prograaa. 












5- failure to desljp curricula and systems for hl£>-lef>act, low- 
resistance "mark els" where real Institutional problems can be 
■olved. 













R. RESEARCH AID tCYELOPMOT 




1. lack of e staple author language which would enable 

teachers U prepare effective progress without es tensive 
training. 



?. lack or riperlaental data nad theories la lrarrUag 

psychology which would facilitate the design of effective 
CAI programs appropriate to each age level . 



3. the lack or personnel with appropriate training and talent 
In th* divers* discipline* required; !.*•• Instructional 
psychology, enquler science, engineering, educational 
administration. radio- TY-fUn. 



k. 



Halted auaber of Instruct tonal subjects la which CAI esa 
he effective - e.g., aath, spelling, hut not history, 
writing. 



ammnn n (cmt'd) 

WIT HA VI OOKFVTD6 HOT MCOKE MOFL VI CUT USED I* TKE USTWCTIORAI. PJOOSST 



c. ncornwes/DisnaBvnoa 



1. Utk of professional Mtitcosmlc laetotlm for Imlopmt 
of coaputer-basrd utrrlali. 



?• Uck of Incenii-^e for dliinlutloc of lonvin. 



J. Lock of itindvdlutloD ot cocputrr eyeless, Halt leg 
free <telua«« of loftvtrr. 



Dttrtar diversity of, and lack of coordination uni, 
school systems throughout the country. 



>• Lack of appropriate archcnlaa* for protretlrg pat r DU, 
copyrights, etc., for CA1 aaterlals. 



6. Lack or aa organ! tattoo to faclllUte Intcrchangr of CAL 
program aaterlals. 



7. Lack of Initiative with regard to dlatrlbuting aortvare and 
providing training and aervlcca for Ita users. 



fl. lack of incentive for faculty aeabara to expend any coo* 
aldrrahle tins and effort In and! lying, nr creating 
alUroatlve, Instructional aelhods. 




D. DUCATIOlAL 5TSTD4 AIR) IKE TEACHER 




1. Reluctance or school personnel to go through reerganltstloo 
end tr slolng that a broad use of CA1 would entail. 



Caetlcoaaesa and uncertainty on part of educators as to 
effectiveness of CAX in comparison with traditional teaching 
aethods. 



3. fear of educators or being reduced to s "but too- pushing* 
cr clerical role by computer. 



*. Reservation sa to poaalbla negative affects of moving 
Instructional process froa social situation and replacing 
Interpersonal feedback with oechanlcal. 



>. Insufficiency or evaluative techniques, criteria, and 
agencies with welch to satisfy educational standards. 



6. Rot enough opportunity for local school people to 
participate in developasnt of CA1 program. 



7. tack of physical apace for squlpatot. 



B. A prevailing attitude that the computer will be used to 
replace poor teachers. (Co^aitera gala wider use where 
they are conslderrd as tools that will oaks good teachers 
sore effective.) 



9. Scarcity of rseourrns available to train teachers and 
Others in the akllls required to usa CAI success nelly. 





68 



a 



QMSTIOH II (cont*d1 

WT HAVE OMGVnnS *0T BXCOKE NOW VZSELT USD IB ttX IBSTBUCTIOBAI. nociSSI 



B. nnvui AID BABDWAIIX 





1 


2 


} 


V f 5 


1. Uck of readily available and good conputtr-beaed 
Nvcitloul nUrltla. 










?. Dissatisfaction with design of prssently inllibli 
Unduli. 






1 


I 




3. Unreliability «*f hardware, la t«ru of frequent break- 
down due to heavy wt by atwdeata ud Inaufflclent 
servicing. 






L 


L 


b. Limitations la the kind of studeat lapuu laterpretsbls 
by the copitir. 




U i 
U ! 




5. Uck of reedlly available mad appropriate hardware 
•yatiai. 




6. Uat of ayetems la which Hard Information la funneled 
through computer's core storage and central processor 
Instead of being maintained |„ Highly accessible low 
coat nedla such as magnetic tape, audio tape, video 
tape, etc. 












o. w-Diwcnoi or cax 






1 


2 




b 




1. failure to retognU* that material mat be completely 
reorgaalaed and restructured if It le to be taught 
effectively with co^mter ays toss. 












?. Application of the "textbook" or ■ Ingle-author mdel to 
curriculum production Instead of the *«evie production" 
model Involving a highly ekllled differentiated team. 












3. Tendency to put too much "oo the computer" rather thus 
ahart the presentation and tearing of curriculum objective* 
with ether laatructlonal nedla. 












b. Inadequate development of a rang* of eo^vter-baeed 

pedagogical technique*. The range might Include question- 
aiwwere, tutorial, drill and practice, slnulatlotm, (Mae, 
problem aolvlng mslia, etc.* 
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ougtrica m 

WHAT sens T9 U 0011 TO TAf Witt fULLT TO POTOTIAL COKWKmO* Of tU COMIVTO TO TO IgSTWCTlOSAL 

fioasst 



A lirp nvter w4 variety Of auutatloM nra rtetlnl In raaToaaa to Uvl> 
quest loo. As Is Qwest loo IX, we b«*t or|ialit4 Um Into ill* tallowing Haas 
cita^riH: 



a. Eoosmnoi 

1. ROtAJOt AST DrVZLOnCEJT 

c. u uJiim /pismiMmot 

». OJCATIORAL fISTDO AJQ> TO TLACKZf 

t. SOrVAItX AST RARSUARE 

f. COST 

o. iit-wiaccno* or cai 

As there Is too suck aster! el tar rrary parti cl pest to corn, «s art asking 
you to to Um tallowing. 

first, select the three (or sort If you wish) Cataprln U which you Ban Um 
aost expertise or is which you are aost Interested, fete each suggestion la the 
selected catenaries us lag the following seals: 

1 ■ uaiaportsat 

2 ■ illftUy laportaat 

3 ■ aoderately lagertaat 

A ■ my !a|iorteat 

3 ■ estreaely or critically l^eitat 

You will aotlee that the lUueatlau differ widely la their scope, iea» being quit* 
specific sad other* ouch acre pwral. Although this a*y asks a oat ceaparlaoas diffi- 
cult, vs are ateerthelsss lot* rested la a rough ladlcatloa of which suggest loos are 
the aost laporteet le each category. 

Secondly, critically essoins the cste^rlss you select sod tmrmt vrr restate- 
w rnt» A ad dition*. or deletions that you ftsl would sake the lteas sore precise sad 
aore assalagtal la substsaca. fleas* us* peg* 10 tar your ecwr&te. Zf you dlsipaa 
strongly with sa ilea, ask* < note of your reasons tar dlsagreeasot. 



— IMWIlWIWi 


1 


? 


} 


A 


A 


1. If CAI can coat to bae* powerful reavlt* for Hack. Puerto Mesa, 
and Mrs lean Aaerleaa eh 11 drew, thle -111 eravld* «& ummu 
1 scent lee for Its at. 












2. Mount on* crltlcal-nans-slte expertneat that would deaoastraU 
the ecopoede cospetltlreoees of the computer lo lastructlea. 












3- Mare educe t Ion goes on outside of Um education eetabllshacat 
than la It. Desnsstrate la the allltarw. eawerwalal . or 

•fflclescy of CAI sod thee It wtU seep lato the educational 
estsbllsharat. 












A. Working CAJ.bMtd nodel schools seed to be developed thst show 
how schools caa Incorporate CAI. 












5. CAI seeds direct federal coo tract a to supoort the develocaent or 
»f.feral . conplue protraen. escb involving thejartlrloatloo of 
sje.lecrsltl, s school *TMm. and , producer or nubllsher of 
educational eater UU . There will be little aroeresa until ika M 
Is a body of actual ante rial with which to esperlasat sad to 
denoastrate. Aad Um costs of preparing initial m ter lain are so 
high and the laves taeot so risky that other sources of the sub- 
stantial In era least Involved are unllkaly. 













►*s'> 
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CtfK.Tl-iX m (xr/.M) 



WHAT KEHC 7$ tt CCAE *.J ?AF H)fE FULL! TUT rOTETHM. CGXTH 1 JWTIOJ 

cr the ccHivrm w me lrmncnoatt. noa set 



*. fisukh axj iritizpsvr: 




There t» a need for trained Instructional grnOBBg | 

•no would be fnlltw «tu the sp educations of needs, ptli, 
performance ob.'*etJ»n, with Unnlirtl planning of 

systea architecture, flowcharting, use or Instructional pva- 
dlftna. use of confuter aide to each stage of th- Instructional 
destgn froceti, with author input sysleat, tacludlrg pre- 
processors oil earro eipanders, and with ways of ctsacunlcatlEg 
both with autbun vA with product fan per wnel . 



2. The computer provides in* truser.tatlon for a tev Mtrtolnn of 
tnstruf ti.-m which departs frea the atlili and i^radtgjui familiar 
In HjfriBfBUl p-jcholcgy . K*v adtli suit kr developed aad 
disseminated to reseamert throughout the country. 



3- fcvel or«ent If needed of methodologies and technique* that 
allow the faculty to analyte the basic concents it their 
fields and qrgartre these Into useful aodules that can bo 
effectively ( men ted wttn computer support. 



CAI'a '.rahlltty to tolerate such latitude tn student responses 
Klvea It a rigidity insulted to *a.v subjects. A Considerable 
Inveateent should t* Bade In artificial Intel! Igencc . with the 
objective of enabling the computer to accept and analyte fret- 
fora student responses or questions. 



Our present knowledge of Individual differences does not begin 
to put us in position to ta*e real advantage cf the computer's 
potential. The a:qt urgent need Is for eatetslve research Into 
(a) testing techniques able to mate fine dt aerial nations of 
acnleveaenu, potentials, response patterns, learning patterns, 
etc.; and (b) the development cf differentiated sequences of 
Bate rials responsive to the individual patterns revealed. 



C. WCttTTVtS/DISTOlWnOJI 






1 


? 


3 


k 


* 


1. Financial Incentives for teachers to take training courses in the 
use of CA1 , 












?. The identification and production of hardware and software for 
•aas sarttu will provide necessary economic incentives, this 
leaves the problem of Professional Incentives however. 












3. Annual national awards for best CA1 nromsama. 












h. Federal funds should subsidise dUcltlU-. based rrojptnn (like 
tne XSF-spontored Commissions on Collect Physics, Geography, etc.) 
which ourfjt to draw upco the most prominent members of the disci- 
pline to assist In the development of Bate rials that mA» full use 
of tne computer's Instructional capability in the discipline. 












5. the establishment of graduate rmArams In disciplinary desartment-a 
ortet.ted toward teaching rather than research would be a «<<ir . 
Indeed crttleslly Important • step toward advancing the develop- 
ment of educational innovations. 












C. It would M a helpful step for government or private agencies to 
MAC flnnnelal inr.nttvn available, at least Initially, fnr 
potential writers of CA1 programs. 
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QWSTiai III (canfd) 



WJUt *L£K TO BE DOSE TO TAP HCM rJt.LT T^Z rCTWTIAL COSTBlUmOS 
Of THE COKJLTTO TO TUT I^FJCTICSC TfCCSSST 

D. EDUCATIOIAL SI S7W AJO THE 7 EACH EH 




1. Ccn.crsloe of our «mnl educational ijritra to Ulw far rrntfr 
W» Of lndt vld jails ed Instruction techniques. 



?. It la necessary to construct full curriculum units la which computer 
Nll|( plays an Intrinsic part, because without this, teacher* are 
forced to tear apart a curriculum, In* art computer activities, and 
reconstitute the curriculum * • tMl for which teacher* have no tine . 



3. The teacher vho use* somebody else** testbook can atlll take the 
view that he la glvlag hit ovn course. With CAl naterlala. tbla 
a at la fact Ion be Car a a or* tenuous. It mltfit be veil to study how 
CAl aatertali can be prepared with a sufficient b uabe: f options 

for the r^orttne teacher to sustain the position that bis course Is 
essentially under his own latelV/’tual control. 



k. Very little progress is likely to be made unless the teacher 
t rat nine Institutions enter CAl In depth end with a decree of 
professional confidence. This would have to loclude practical 
training lo the actual toe of the hardware, an understanding of 
the soft* are, and the techniques of integrating CAl with the 
traditional education prvcesa. 



J. Supp«t workshops in CAl ought to he provided for teachers, similar 
to those supported by IGF, however, involving handa-ou esperlence 
with available ayateaa. 



6. The viewpoint should be adopted that major Pro A ran development will be 
centered In the schools. Teachers ought to be encoursgtd to cone 
up vltt Ideas and prograaa which they ce^ Immediately put into 
practice. 



T. Courses in Individually prescribed 1 rat ruction and saall-sroun 

tutoring should be provided lu wery school of education. Educators 
would flod It easier to adapt to conputer-baaed systems as a result 
of having • note appropriate background, while at the sue tine 
schools would not feel they were making an Irrevocable Investment 
In CAl. 



I. SORVANE AJO HAMVAKE 



1. It la essential for the producers of software to agree on a 
format that will make It usable In Interchangeable hardware . 
This calls for considerably more sslf-pollclng of the Industry 
than ealats at present. The alternative la a scattered effect 
that will make no lasting l^aet on assa •education and the 
■ass market. 



9. Analytical research la needed to Identify relative l^ortance of 
dlffTvnt tvrea of hardware lwterfarei l.e., keyboards, e.r.t. . 
audiovisual, etc. 



J. There are two hardware reae! foments tf vs are to enhance our 

capability to present ftrsd tnfornatloa without passing It. through 
the ecntrnl processor of a computer. Theta nre: (l) a high volume 
ranees acce*'. audio unit for use with a computer in teaching 
reaming and languages primarily, and (?) a computer terminal which 
makea use of the video cassette principle mow beginning to appear 
for the home market. 




J_ ? 3 k lb 



k. Consideration needs to be given to wll-desUn*4 and versatile 
student terminals. Most current terminals are ugly sod unpleasant 
to use, giving the wrong "Image*' to computer usage. 



5- A break- throw la needed In the development of autillarw 
computer storage and presentation devices . 



CUTSTTCH HI (wnfO 



WMAT IfQIC TO B£ tOS£ TO T AT MCHE FULLY THE RTTITTXAL COinWXKJTIOs 
OF TKZ OOHFVTLH TO THE IKSWUCnOIAL PROCESS T 




1. Cut the coat or control trottnor liar to the nelCiborbood of 
904 per hour per port. 



A E3tt->h«r{pa pragran for school districts sod learning eentrra 
inilalllng a computerized program. THIS might be dooe on tie 
basis or, ■ V f? per hour, for each hour or student use on a 
terminal. 



3. The cceHnstlcn of large ttfw-aharing computers and cable TV 
say offer relatively low-cost CAI application. Efrorts seed to 
be timed at developing appropriate hardware. 



Cost breakthroughs rcaulilog from utUtiatlcn of eatsting 
Qqftgun ter. Hone cqulreent . For eaaeple. conversion or etlltlag 
electric typewriters to to consoles, ditto TV's. etc. 



There ought to be an e Urns 1 ve aad rnrrdlnsted effort to bring 
down the cost of CAI equipment by arPlied research . Ccmpuler* 
baaed materials should be able to compete economically wltb other 
learning aril a. l.e., books, blackboards, etc. 



PS-DIRECnOJI OF CAI 



Creater cap has Is on s wide range of counter support for 
leaning and ajch leas focus on the tools provided by tradi- 
tional CKl (tutorial, drilled practice, etc.)* 



Many of the applications of the computer to education have 
been pedestrian or have Involved tasks that night well have 
beeo accomplished through relatively loespenslve but well- 
prepare J programed testa. Ve should be doing sore frontier 
work and less glmlckry. 



Education la oot likely to force eoaputlng costs dom/ard any 
■ere rapidly in an other Markets for cospuiers ate new forcing 
costs downward Therefore, education would be better advlaed 
to concentrate, on unique needs la computing hardware and software 
and slvply wait out the coat problss. Tutorial CAI aad drill 
and practice CAI are now cost- Juatl Tied la only special ins lanes a 
such as remedial education, special central-city situations, 
etc. Computers can ba cost -Jus tl fled sow for us a la problem 
solving In schools, for data procss sing education, for alaulatlm 
and gases , and for certain computer- man age 1 Instruction appli- 
cations. 



Simulation ts the single area where the roaputer eaa provide 
toaethtng which cannot be provided by other tnetiucllonal means. 
There should be a greater concentration of effort oa the develop- 
ment of a imitation sate rials . Tor which there Is a substantial 
aarket potential. 



Xa view of the critical reading retar.iat.on problem , especially 
manifest In urban minority chlldreo, major concentration should 
be on designing two or three alternative C *r w^er— 
dJrvetlr- at _thia specific jrgbiea . The social needs are greatest 
there, and the resources for fendlat research aad drveloparnt 
are greateat there. Moreover, successes In this sector would 
attract much feller support, fer other applications of CAI. 




QUESTION III (contM) 



Note: Please use additional sheets, or the reverse aide of this sheet, 

if you vlsh. 

Restatements, additions and other comments : 



Signature 



Date 




/* 
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EDUCOM 



IN TERUNIVERSITY COMMUNICATIONS COUNCIL. INC. 

Hwt 0*ln.e (la* MA • Mom *t+to Hoad. PtmotOfl. New Jtdty 08SJ0 • Tetepfton* 60^821-7375 



QUESTIONNAIRE 3 



Study of Factors that have Inhibited a More Widespread Use 
of CoDputers in the Instructional Process 



Attached is the third and final questionnaire in the sequence being 
used in this study* It is based on the responses of the thirty par- 
ticipants to the preceding two questionnaires. In it are represented, 
in sumarized form, the group's evaluations and Judgments in the areas 
that hsve been brought under consideration. You are requested to 
react to both majority opinions and dissenting viewpoints in each area. 

We wish to emphasize the importance of your comments in enabling us 
to accurately interpret and represent your point of view, and encourage 
you to comment freely and critically wherever possible. 

The questionnaire is divided into three sections. The first presents a 
tabulation of responses regarding the desirability of, and the computer's 
contribution to, a number of possible educational changes resulting from 
a broader use of CAI. The three new Items rated in Questionnaire 2 
are included. 

The second section deals with the obstacles to CAI acceptance. It 
presents the group's evaluation of topics in eac?« of the six areas which 
were examined and rated in Questionnaire 2, ana asks for a re -evaluation 
in light of the group Judgment. Also requested are your reactions to 
consents made by other participants. 

The final section concerns your ideas as to what effective actions might 
be taken to further the growth of CAI, in value and acceptance. You 
are requested to describe, as explicitly as possible, the ways in which 
your ideas aip.ht be implemented. This section of the questionnaire 
will partially provide the substance for the conference to be held in 
November. 

As in the preceding questionnaires, we wish to note that the term 
computer-assisted instruction (CAI) will be used as a generic term, com- 
prising all aspects of the utilization of the computer in an instructional 
context. Included within the scope of the term as used in this study 
will be what some have preferred to call computer-augmented instruction, 
computer-managed instruction, computer-based education, and also problem- 
solving, gaming, simulation, etc. 



O 
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:■ w*ut w*t*t ix' ho.:nn ■naT tm xt or cowt/roe is i*STKcrto» w’xac :»ck>vt 

t» hajCat'.wc. rmctsz ? 



?.» r»»{cjnr» to w n« Item tatniKti to tbe i*t*4 
systn inllrstel tuaatiatlt! s/reeoest saroy resident* reysrdtny 
!•» IntrttMit; of, «nl Vw coqtitir'i fotntlU nctrtbutlM 
to, tfce edoc s; torM insrosearnts conslirred. TVrefcre. *.he 
d*i* fJr thr r.rw ttw, (I, 3 , snd 6) fc*rc stwply hern Includrd 
ura^ i l .» utwr U for*. 

Ttf liu *re jrwtBiei u tor yrspfi* te41cit!w, for every 
lien, the filter of rv**po«i»es la esch csteyory. Th* Itens ore 
rsnhcd Is order cf tit* **oo rvtpcur (••ersyrd over cstecortes 
A ood I). 

Hrup etodJne *»« list, ond rnsrnt on on/ points vMeh yog 
tejir»r could te lofroved cr with wntcS you dlssyree. (Use 
the reverse tide of the oneet for ccoornta.} 



t-rstrsb titty Cafutfr'i 




Wjutl en stole * talent* to wors with trcblm Is Systran or reollotlc 
c copter |ty; e.|. t In icteuei, biai«Hl, enylneeriny ml aedldne. 

Would provide Instant feedback . with the retail of ar>re off Iciest 
letmlM. 

Would provide for o>r» blyitly Irtersctlve Interctooeoe between 
student and body of Subject aotter eft ere by the student would 
Inter royste ond esp lore, rstber l non assimilate Isromniton frcs 
S teacher. 

Would eeoblt student to proceed si own rots, without pressure or 
lockstejplny. 

Would fsrlll tste flestbil tty of :*%rntny proyrsa with regard to 
Use snd ploce; e.y. . courses could be node available In public 
libraries fcr svrkiv adults. or In twnes. 



W.’Ud ns*c it possible f^r educational procrsM to be oorc accurately 
snd * I yn Ifl cor. tty evaluated, ollcmtny syttetotlc revision Cf ecurse 
wstcrlol to Oftisire teaching effectiveness. 



Would free the tescher fro* the I 
aspects of tesrhlny. 



:re routine, drill** 



Would so*e possible Immediately svollobte reccrds oc Students’ 
leornioy Metery, facilitating yrester individualisation* 



Wjatd enroufsye • snre freely quest lofitliy sttltulc toy rrs)v|ii| 
fese Of anting erron< r r oshiny It^pproprlst* questions. 



Would help to m.ufe t Inn-free riucotietisl envlronrrnlf for 
•it*'* Ilf yr»up>a. 



Would 11.* ft to* r*}»’to£ l~ •«* studet.t « vslustlon towsrd strain* 
seot .*f ubjectlvf teornmr criterts ont easy fro* placement In 
S Oitnltlvr curve. 



Wwwl I yrev.dr o mre rent rolled learning envlrmaciit , student 
not 01 subject to the negml ve Influence of ftcr tetchlsy. 



W'uld enstole student to select Ms own lemming sequence. 



U. Would free Student to concentrate on aster I el to be learned 
without pressure of c*>ep'rt 1 1 Ion free peers* 
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nKCTION II 



In thlf section, the results of the preceding questionnaires are presented, 
grouped Into the following six categories: 



A. DOCKS TRATIOS 

B. COST 

C. PHODUCTIOK/DISTmaunOK OF CAI MATERIALS 
0. EDUCATIONAL SYSTEM AND THE TEACUP 

E. RESEARCH AND DEVELOPMENT 

F. RE-DIRECTION OF CAI 

For eaeh category, you are asked to react to the group data in the following 
ways: 

(1) re-rate each item, consenting where you disagree with the 
najorlty opinion, 

(2) evaluate the over-all descriptloo of problems la each category, 

(3) react to suggestions and cossaents from other respondent!. 



Instructions for rating: 

A slightly different rating format Is used In this questionnaire . la each 
Item (see the example below), *M* represents the median response to the Item 
fro* Questionnaire 2. The bar Indicates the range containing the middle 50 1 
of responses (the Inter-quart lie range). 

Please rate each item again, and comment wherever your ratine falls outside 
the Inter-Quart lie range . 

For Instance, If you were to check category 1 or category 5 In rating the 
following ltea, you are requested to state briefly why you think the rating 
should be that such lower or that much higher than the majority oplqlon. 



The aamr scale Is used as In the previous questionnaires: 

1 ■ unimportant factor 

? ■ cllghtly important factor 

3 ■ Rtxlerately lcq>ortant factor 

k ■ very Important factor 

5 * extremely or critically Important factor 
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A. t .-MONSTRATI OK 



WIT IAVE COKWTtJO WOT HOOKS WU VIW3.1 USD II Ttt IVSTWCTIOIAL 

mass! 



Ww# Thy folloolmt . u dftcrlbfi la Ut 

lsatrurtlona on p«|t ). 






1 


? 


3 


L 


5 


M. too few • snap lea of high quality uae. a 








M 




tf. failure to deal an curricula and ayateaa for hlgh-Upact, low- 
reala tance 'aarketa* where real laatltutlooal p robins can he 
aoleed. 








M 




dj. Lack of excelling evidence that CU la aort effeettee than 
other arthods of Raparablt cost. 








J 


1 


It. Lack of carefully planned bread prograaa of CA1 eiperi- 
aratat loo la actual achool aettlng*. 








J 




d>. Lack of "critical aui* lo aettlag up prograaa. 






u 





Coffit b»r» or on 
> r«»r»» aMe of tat 
aheet If /our ratlal ixi 
eot fall within the ru<f 
Indicated : 



to row f«l that oil la an accurate reprearatstloa of Ur pnblm la thla anal 
(What ef r ata would you add to aalr tba picture aora ccraplatet) 



te fral that the satura of tha problraa la ula area differ* a 1 gni fl cunt I7 for dlffarvot leetla 
of education le.g., pre-college aad college)! If to, bout 



•thla lUa ha* been restated. It wa* forwrly “Ibo fra esaaple* of hi ah quality iae, at laaat la tte 
•yra of persona eipert la the discipline and la teaching that discipline. Perhaps too arch at test lor 
to technology nod not enough to auhatanc*." 
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A. DEMONSTRATION (cnntM) 



WAT mas TO BE DOVE IN THIS AREA 10 TAP (CRT FULLY IKE POTENTIAL OP CAll 



l*lov are three responses to this question which wart the aoat highly rated In the previous 
questionnaire (La terms of ae«a rat! ox* of Inportancv). 

•1. CA1 need* direct Federal con tract a to support the development of several eaarlete 
programs . each Involving the participation or a uni very 1 tr „ a school srtten. and a 
producer pr_t>ubltaner of educational aaterlala. There alll be little progress until 
thsr* ta a body of actual aaterlal vlth which to exyertBsat and to dewaatrete. And 
the coata of preparing initial aaterlala are ao high and the lavea tarot so rtafcy that 
other aourcea of the substantial la vest amt Involved are «» likely. 

92 . Mount one critical— aaa-alte rsrerlarot that would demos trate the econoalc coape tU 
tlveoeaa of the coaputer 1 b Instruction. 

O. Working CAJ- baaed wadel schools need to be developed that show bow schools can 
Incorporate CAl , 



Arc there other auggeetloos which you believe are eore 1 sport ant than theael 



foJ lew log are soar represent stive coa a co ts froa respondents. Please Indicate whether you agree 
or disagree, and ewat wherever you feel It la approprlaU (use the reverse tide of the eheet for 
ailltlooal apace). 

Coaerat If appropriate: 

*dret_ 

Disagree 



Agree 

Disagree 



.Agree 

Disagree 



1. "Attests to laplcarnt CAl In schools before It la fully 
developed eight generate a backlash that would seriously 
affect later developaent," 



?. 'More trial and error lo needed before CAl la ready for 
the risk of • large-scale de sons t ration. " 



3. "teaoeatratlona should reflect a wide variety of alter- 
native Instructional uses for the coaputer." 



fro additional questions were reflected In co aa en ts of a nunber or respondents. Please provide a 
brief answer for each: 

!• At what level or la what area of education would CAl be 
Initially aost effective and *o*t likely to induce » 
widespread acceptance? Cl.e,. what are aajor ’hlgh- 
Inpact. Iwrrsl stance * areas— see A?,) 






Vhlch la aore critical: the lack of denut ration of Mu- 
tuality Instruction, or of econoalc feasibility! 
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WT RAVE COKJVTtHi 10? tECO*l MOM WIOUT UCH' II TW TCTlWCTlOlAi 
FROCKS! 



ntuo re. rot* tho foil owl no. u d'acrlbod in tho 
tMtrWtlOM Oft pot# ). 


A 

/>/? 


?A 


yjT 

w/i 


i 


7 


i 


A 


5 


fel, ftet that CAI la a* add-on coat, not rrduetac Inatructle**! 
budfot, and r*tulrloi additional prog rami a* pcreoaaol. 










w 


». Ilgh capital tavoatacat a#on tmaro «oo4 coat -effect I vonooa 
caa bo achlo«o4 In tha lon« run. 










It 


laa true t tea. 








M 





■Ml horo or m 
tfc# rrtrtno old* of thla 
♦Root If fo ur rutM to» 
foil vltkll Ifeo rant# 
ln41 cato4i 



Do /w fool uit thi-i !• on occur* to rtproiiiutton of lk probloaa It tt!« inot 
(Ail t Mio tt vn 14 you *44 to Mko tbo picture aora t«M)rlll) 



U> you reel IMl IM ■■tort of tho pnbltM It thla tr#a 4lrf#r« •i«nirlcMtlp for different l#o*le 
•r education U.|., pro- coll# to on4 eolltfolt Ir to, bo*! 



O 
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:t. rtW7 (ronlM) 



WHAT MKC TO HE MhE IS THIS AREA TO TAT HIRE PULL? THE POTEHTIAL Of CAlt 



Mow arc th rre response* to this quest loo which received the highest **an rat Inn* , In ten* 

of Importance* In th* previous questionnaire. 

bl. There ought to kf «n Ntcciht and coordinated rffort to brio* down th* cost of CAT 
equipment by afplled reiearch . Computer-based materials should be able to roopet* 
economically with other learning media, 1.*., books , blackboard*, etc. 

b?. T>* combination of isrr* time-sharing computers and cable TV aar offer re 1 all rely 
lwcoit CAT application. Efforts need to be aimed at developing appropriate 
hardware. 

bl. Cwt th* coat of central processor 1 1 me to the neighborhood of ?0# per student 
isntart hour. 



Are there other suggestions which you believe are nor* Important than tbeaeT 



Following are ace* representative comment* froa respondents. Pleas* Indicate whether you agree 
or dUMrrf. and coasted t wherever you feel It Is appropriate (use tbe reverse side of tbe sheet for 
additional space). 



1. “Ordinary economic k -*ur*s, combined with technological 
advances, will bring - cost or computer and 

cominlcatlona equlpm ew; this la primarily th* 

way that the cost pr>t • resolved." 



Agr**__ 

Dlsagres_ 



?. "‘Cost-effectiveness* Is not a ter* which Is relevant to 
present education. It require* specific objectives, which 
ordinary schools don't have." 



Mr** 

Dl*sgr»e_ 



Consent if appropriate! 
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*\ rp^icrjoM/iu/TMwrioN ok cai matekia j.*> 



tmi MAVT *»? ►r'XKE «%)!«: WIMlt U3E> !» TKl ICTTUCTtflUL 

r «<•»:*• 



fltxr r»- rot* »■< • •• r 1 b>» d In tho 

tmt ruction* vn (*.•» ). 


A 

t 


% 

? 


% 

% 

} 


A 

1 

i 




Cl. !*.•• if r-«ltl/ **o1Ublr or 1 *"«r<utrr*t*ird 

r ducatt-Tol Hl*rl«l(> 










M 


Cl*. lorr of |rof*t»lon*l and rcorvoir Inrrntt*** for 
<1***1 ajornt of croj ut**.t**»d notfrtolo. 








M 




C). tack of Itmilt* for faculty »*«e*rt to rirprnd ony 

«vn* 1 Wafelr tin* or. 1 rffort In o»wHf/|n«r # or Cfrattn* 
ottomott**. lo»t notional nrthod*. 








V 




Ck . I.ack of lnrmtt%r« for dtk**»lnatlo« of noftwarr . 








M 




CV Jt|fUr«tlOfl of thr ‘trittoot* or • In/lr • author »i4r! to 
curriculum production |nit*«t .of »h« "no*** | reduction* 
indrl Involving o Myhty illlM dl ffrrrnt 1 at*d lf*a. 






M 






Ct. lock of with ifyrjfrUl* training and 

talmt In th* di**r»“ dintlplin** rrqulrrdi 
1 n«t ruction al piychology, ccapulrr icl»»*», nt|lnrrrlR(, 
r ducat Irani adalnl it ration. rndlo-TY-f 11 b. 






M 






CT. Lock of itandardilntlon of «*pMtrr iyitr«, Halting 
frr» richnng* of loftinr*. 










fl, lock of off mprlntr ur.hnnlm* for protecting p*t,*nti, 
copyright*, rtr.. for C/I atlrrlilti 




a 






C9. Lock or lnltlotlv wit*) regard to dlntrlbutlng loft ware 
and providing training ond irrvlm for tto unrro. 




:r 






CIO. Lack of nn ormaltktlm to rocllttotr Interchange of CAI 
|ro(ru material*. 




i 







Ciwnt hrro or on 
r tif r#»»r*» il> pf into 
• iwrt If /our rot In* dor* 
not foil within th# rw>Kf 
lOdlcotrJ: 



ft- r-u frri thot thU Ir on orrurtt* rr /mm tot Inn of th* pro* Iran to tMf arm? 
(Vh«t n«n*(iti »o*M ;ru oil to Mf thr picture jurr cuarlrtrt) 



** you fr*l too* tt# notufr of thm r roMmu In tMo orro dtffrro ol/ntrirutty for dlfftreot Uitla 
of rdufotlon prr-rol tr/r nr4 collr/rjl If no. howt 




8'1 
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rnoDucTio:i/DiaTHirvirriu:; of cai materials (contM) 



r. 



WAT »aw TO W WSE 1* TOIS WEA TO TAP K>KE WU-T TOE POTmtlAL OF CAlT 



*< r irppw.r* w vmi ^iiion «Mfn yfrr » 

qu«a tloonal re (In uru nf ae«n ratings of taper lance). 



el. TOere Is a nerd Tar tpalnel Instrvrt |onal jgajgfi neraonnel who would be 

ranlllar with the specifications of nffli, Foals. perroranncr objectives. with 
behavioral analysis, planning or syslea architecture, flowcharting. use or 
Instructional parallels, use or c<mjulrr aids to each stage or the Instruc- 
tional design process, with author Input tysleas. Including prep re res »rrs 
and macro esparder*. ar.l with ways ©r coasun l c at l ng both with authors ar.d 
with production personnel. 



e?. It would be a helprul step fsr govemnrnl nr |rlvste agencies to ask# 

financial Incentives available, at least Initially, ror potential writers 
or CAI pro grass • 



eJ. federal funds should suttldlte dlsHfllne-based /reurlnew (lUw the HT.f- 
» pons o red CoocJsslons on College Ihystcs. Geography, etc.) which ought bo 
draw upon the aod | rcnln*nt mrnbers or the discipline to assist In the 
development 0 r nsterlals that sake rull use or the computers In.lructlnnal 
capability In the discipline. 



Are there other suggestions which you believe are n>r* l^ortant than thes-T 



following are none representative rosasenls fro* respondents. Please Indicate whether you agree 
or disagree, and coaarnt wherever you feel It is approprlst# (use the reverse aide or the sheet Tor 
additional space). 

Commral tr appropriate: 

Ag 

Disagree 



Agree 

Disagree 



Agree 

Dlsagne 



1. "Purely rinanclal Incentives will draw relatively incom- 
petent people Into the rield. Attention aunt be given 
to maintaining professional standards.** 



7. "The problem or erred! ve distribution or CAJ materials 
and systems will resolve ltseir once there Is a sack el 
for such materials." 



)• "local people are generally not qualified to write CAI 
mrlerlalv, nor would haw the necessary Hap. 

fesults te'ul d be highly Uii^v-n m quality." 



An additional qm-illon shr*- Trtm coammu or a nuhfeer or respondents. Please provide a brier answer, 

1. Who art- nest likely to tK- the prlanry producers or CAI 
course materials? 
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P. KWJCAT10MAL r.Y.VfkM Wilt THE TEACHER 



win un oowvme *vr ^ trust »«. wiuir iro i« tot ijctfjctioiw. 
nocisst 



Instruction* on page 1. 


1 


? 


I 


k 


5 


PI. Pelwrtanee of school personnel to go through reorganisation 
and training that a broad use of CA1 would entail. 








M 




PP. Csullouaeess and uncertainty on part of educator* as to 

effectlvene** of CA1 U coup aria on with traditional tearhiag 
•Hindi. 






V 






PI. Scarcity of reaourcea available to train teachers and 
others In the shills required to uae CAI successfully. 






V 






1*. Fear of educators of being reduced to a "button-pushing* 
or clerical role by couputer. 






V 






to. heaervatiens aa to possible negative effects of removing 
Instructional process fro* social situation aod replacing 
Interpersonal feedback with aechanlcal. 






M 






t)(«. Catreae diversity of, and lack of coordination aasg, 
school systens throughout the country. 




M 






- 


W. Insufficiency of evaluative techniques, criteria, and 
agencies with which to satisfy educational standard#. 




u 






to. A prevailing attitude that the computer will be wed to 

replace poor teachers Instead of to make good teachers nor* 
effective.* 




u 








TO. Pol enough oppnrtwtlty for local school people to par- 
ticipate In dsvelopaent of CAI prdffrsw. 




u 










ihrft If your rating does 
not foil vlthln the rang* 
Ml(ilr4i 



to you feel that thU la an accurst* representst loo or the problene In utla art at 
(yhal C o—m t« would you aid to sake the picture nr* couplet*!) 



to you feel that the nstwre of the probteai in tMi area differs significantly for dJffsreat laeelo 
of education ( re- college and college)! If so, howl 



•Thla Ilea nas been r*Matr4. It «,« fomerly “A prevailing attitude that U?CMg>utir will be uaeg to 
replace r*»e teach* r . (C.w| ultra rain wider uae where they are con* l Acred aa tool* that will take good 

Itirhcr* B.rr *rf»plitr.l* 





tk 



D. EDUCATIONAL SYSTEM AND THK TEACHER (ront*d) 



what mm i\) w tnnt i* this area to tap mn folly the potcptial op cazt 



Below are three reiponsr* to this qursitoa which received the htfhrai Been rating*, lo ten* 

of Importance, In the previous questionnaire. 

41. Conversion of our general educational ajratea to allow for greater me of Indlvt4uall«e4 
Instruction techniques. 

62. It la necessary to construct full currlculua units In which computer usage plays 
•n Intrinsic part, because without this, teacher* are forced to tear apart a cur- 
riculum, Insert coeputer activities, and reconstitute the currlculua - a task for 
which teachers have no tlac. 

41. gusewr workshop* In CA1 ought to be provided for teachers, similar to those supported 
by *sr. however. Involving hands-on eaperlence with available aysUae. 



Are there other suggestions which you believe are sure lapnrtant than these t 



following are lose representative comenU fro* reapoodents. Pis see Indlcsts whether you agree 
or dlasgree, and ecaasent wherever you feel It la appropriate (use the reverse aide of the sheet for 
additional space I. 



OoacBt If appropriate: 

.Agree_ 

Disagree 



Agree 

Disagree 



.Agree 

Disagree 



1. "Any CAl eye tea which allows students to proceed si 
their own rate will create Insoluble administrative 
problem for t-aJ It tonal achoola." 



?. "CAl progran develofuent should be centered In schools 
so that teacher* can actively participate In, and con- 
tribute thrlr esprrlenre In. the dr*clu|*wnt of Idea* 
and progrwa*." 



I. "CAl Material', should lx* prepared with a sufficient 
number of options for the adopting teacher to sustain 
the position that his course Is essentially under him 
own Intellectual control." 
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hk:mrch and :iKVKi/>!MF.?rr 



WMI MVt OCtffVrtK BOT hfCtKT M'Ki. Wtfclll UBKI M TWZ IfCTHUCttCilL 

riocissi 



flMW tlw fMiftoln/ . on described It the 

inttnttllcnt o* jy» J. 





1 


i 


5 


k 




a. bissatU faction with devlsm of presently avrl.ofcle 
terminals. 




xL 






E?. Limitations lo trte hinds of student Inputs l t.erpremie ty 
the computer. 




UL 






IJ. Unrel tail llty of hardware, In terms of freq\*-U break* 
downs due to hasey use ty students an4 insufficient 
aerrlclftf . 




EC 






I*. Use of lytteaa \ n vt.lcn fisei Information Is tunneled 
throudh computer's tur* «torw# and central prct#i»«r 
Instead of belnd maintained le ftieMy arret* ) tie l.w-cost 
media such aa iwwUc tape, audio tape, eldeo tape, etc. 




1 






ty. Lack of rendtly available wid appropriate hard* are 
systems. 




M 








U> lack of a simple author lanpuaie wnirh wculd enable 

teachers to prepare effective prtrraoo without eitenstve 
tralalft*. 












17. Lack of etyerlmental data and theories l« learning 

pay rhotOQr which would facilitate the design cf effec* 
Use CJU prodrome appropriate to each a«e level. 




M 









Cc«s*t.t here cr oft 
■ rtttrtt 1 1 i* of this 
r your ratio* lv*i 
net fall vltnln tit* rvi? 
Indicated: 



It) you f»»l that ttli I • an accurate representation of tut probles* ta this area? 
(Vhat w nani tl would you odd lo Mtt the picture *crt complctt?) 



U» you feel that 
of v location 



nature of the protlena la thlo area differ* tl*nlf leant 1/ for different Itteli 
(r.f... pre-Colley and Colley)? If ao, how? 



O 

ERIC 
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K. MSSKAHni ASt» DEVELOPMENT (cont'd) 



MUT *U20 10 BE DONE IN THIS AREA TO TAP NOME FULLT TR1 WHTO tt OP CA2I 



Btlow *rt Uirtt rtipoMii to this quest loo which rtctlw4 lh« hl|Mit hib rating , to tino 
of laportancr. la the previous quest Iona airt. 

lOwlopoent la needed of methodologies u| techniques that Allow the faculty to 
MAlytt tbe bult corcepta In uitlr fields and ortanUe th.** Into useful 
*pdul»A that eon be effectively prtintid with computer support . 

e?. Ihe computer provide* Instrumentation for « nev ptycholoar of instruction w ilch 
departs from the —dele and paradigms familiar In seyerl—ntal |»ycholocy> *rv 
Kdsla Mt be developed and disseminated to researchers throughout the country. 

eJ. Cooslde ratios aetda to he given to well. designed and versatile etude at terminal a . 



Are there other suggestions which you believe are sore Important than thesef 



follovloi are soar representative coasnti frua respondents. Please Indicate whether you agree or 
disagree, and consent wherever you feel It la approprlata (use the revere# aide or the sbert for 
additional apace). 



“CA1 require* a great deal of further development and 
study through disciplinary research and Industrial —**"* — 

deve lopmmt before It la refined enough for wide use." Waagree_ 



?. Rrseerch cone I derations are very Important In the loog> 
range view, but other factor* are of more (Mediate 
concern,'* 



—.Agree 
Disagree^ 



3. "instruct It n Is still an 'art*; Instructional theories 
are Irrelevant to making better materials." 



_ Agree 

Dfasgrtr_ 



Co — eat If appropriate! 
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BK-MHKCTION OF CAI 



Wilt HAVE CWCVItKS *3f UOM ICU WlWLT USED I* THE r* 3 TWCTI«UL 

rmcsai 



Hww ro-ratr ts» following . U Aiicrlbtt U lb* 
iMirvctloM os pa#o 3. 




n. failure to rocofnU* that notarial Mil bo eoaplotalj 
roorfanlioJ u4 roatrorlurod If It la to bo lau«ftt 
rffrctlerljr alt* consular ijriM*. 



Ukb^ali dmlofanl of a raa«o of roa^uU^liafl 
poAiio^lcal tocbAl«uoa. The r«|» alfht Include quart loa* 
aoaaera, tutorial, tolll and practice, iIihImImi, (uta, 
pnMw isl«1*| aodoa, tic. 



TnbKi to put too mcI *» the co^-uter" ratuer than abaro 
tba preeealatloo anl leallaf of currlrultaa objeetleea vttb 
otter lulruc llonaJ atUi. 



■oat boro or os 
tho remit aldo cf tbla 
abort If pour ratine dooa 
«ol fall ollbln tba ranee 
Indicated: 



Co poo fttl that thla la aa accurate representation of tho problaaa la tbla art a I 
(Vhal rnamii wild you add to sab< tbo plev'are aora coopletel) 



to jrou ftol that tbo nature of tho protloaa In tbla area 41 f fora algnlflcaatl? for 41fforont lo*ola 
of tl^allvn pre«collec* aol college)! ao, bool 



O 
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K. RE-DIRBCTION OF CAI (contM) 

WHAT IKS TO IE 00*E I* THIS MCA TO TAP NOW FULLY THE FOTOT1AL OP CA2I 



Mw **+ rfifomii to this question which rwnlTti the blithest nu rttlaii, la urn 

of laponance, la the previous questionnaire. 

fl* *«y of the applications of the co^uUr to education have been pedestrian or have 
Involved task a that night veil have been accomplished through relatively Inexpensive 
but veil -prepared pro* rawed teats. We should be doing wore frontier work and leaa 
gimickry. 

f 2 . In vlev of the critical retardation trpble a. especially nanlfeat In urban 

aloorlty children, aajor concentration ahould be on designing tvo or three alternative 
Mnvd directly St this tteclflc rroblea . The social needs are greatest 
there, and the resources for funding rear arch and development are greatest there. 
Moreover, successes In this sector vould attract Buck ruller support for other 
applications of CAI. 

ti. Education Is not likely to force cooputtnA coats denmvard sup no re rapidly than other 
nartets for coaputrra are oov forcing cost* downward. Therefore, education vould be 
better advised to concentrate on unlive needs la eosqnjtlng hardware and software and 
al^>ly wait out the coat prubira. Tutorial CAI and drill and practice CAI are do* 
root-jictlfied la 00 I 7 special Instances such as rvardlol education, a pedal central- 
dtp altuatlona, etc. Co^uters can be coat- just 1 fled now for use la problea soletag 
In schools, for data processing education, foe alssUatloa and gaaea, and for certain 
caaputrr- nan aged Instruction applications. 



Are there other auggestlona which you believe are sore t^ortant than thrsvT 



Following are soae representative coaaenta fro* respondents. Please Indicate whether you agree or 
disagree, and coment wherever you feel It Is appropriate (use the reverse aids of the sheet for 
additional apace). 

Ctoaseat If spproprlatei 

Agrte^ 

Disagree^ . 



Disagree^ 



.Agree 

Disagree 



.Agree 

'Disagree^ 



1. "CAI la too expensive now for any uses but spedallred 
ones. More effort ahould be given to designing hlgh- 
quollty CAl program for sped fie educational problem 
where CAI night be particularly effective, such as 
remedial education, reading, and calculus.” 


?. 


"TYwre Should be nort cap has Is on (earner control of 
aubjert sate rial and style of teaching.” 


3. 


"There ahould be rone effort directed toward a coaput v r- 
baaed s>itra which would provide support for all the 
Instructional and sanagearnt functions la a school's 
prograa.” 


h. 


“There la not enough leadership In the ares of 
educational chance, *t»lch la necessary If the potential 
of CAI la to be fully developed, national centers are 
needed to do research, to develop resources , to study 



SECTION III 



In this section we are requesting your ld«*aa sa to speelfle actions that 
sight be taken to further the growth in value and acceptance of CAI. 

Select two Cor sore If you wish) of the six arena seaside rad— ones Id which 
you have the Dost expertise or are aost interested— end describe, in each 
area, an action plan which you feel would be a significant step toward renoviog 
obstacles to CAI 'a development. You nay wish to use oos of the three suggestions 
for actions which are listed in aach ares in Section II, or you any cbooea 
to develop a new suggestion. 

In addition to a description of the action plan, include suggestions of the 
source and level of funding, target population, tins projections, and so on. 

Your efforts to develop these plus as thoroughly as possible, which we realise 
la a time-consuming end dcaandlng task, will be very such appreciated. The 
plans will be used in determining the format, and providing the topics for 
discussion, in tbs conference to be held at Us and of the study. 



ACTIOS PUS I 



Ares: 



Description: 



Source A Level of Funding: 



Target Population: 



I 



Tine Projection: 
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ACTIO* PLAK II 



A rot: 

Deter lpt Ion: 



Bourct A Urtl of fUndlni: 



Tfcrgtt Population: 



Tint Projection: 










Signature 
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Appendix 2 

Responses to Questionnaire 3 



F oliowing is a sunimar y of fesponses lo the representative cunmients and 
questions in Ouestionnaiie 3, 



Total Nundiei 

A. DEMONSTRATION of Respondents 

Aqt ei»t i kj ur D is aijr ecu wj 



Agieo£2 

Dis.»grei:^_ 



AqrceJG 
Disagree H 



Agree 19 
Disagree^ 



’’Attempts to implement CAI in schools before it is frilly 
developed might generate a backlash that would seriously affect 
later deveiopment,” 



’’More trial and error is noededbefore CAI is ready for the risk 
of a large-scale demonstration." 



3. "Demonstrations should reflect a wide variety of alternative 
instructional uses for the computer." 



At what level or in what area of education would CAI l>e initially 
most effective and most likely to induce a widespread acceptance 7 
<!.©., what are major 'high -impact, low resistance’ areas- see A?.) 



Summary ol Responses Number of Respondents 

in each C ategory 

Basic skills; math, cuglish •> 

a) at pic-college (4) 

hi remedial nr introducin'} 

in community or junioi colleges 1 3 1 

Advanced work at college level .4 

Vocational, technical schools 

Keruedial programs lor disadvattbtged, 

special ed. children 2 

Industrial, military training 2 

Combinations of the above jt 



Which is more critical: the lack of demonstration of high-quality 
instruction, or of economic feasibility? 



Emphasis on economic feasibility 14 

Emphasis on quality K 

Both are equally important 4 
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B. COST 



1. “Ordinary economic pressures, combined with technological 

advances, will bring down the cost of computer and communica- 
tions equipment m time: this is pumaiily the way that the cost 
problem will be resolved." 

2. “ ‘Cost effectiveness' is not a term which is relevant to present 
education. It rerun res specific objectives, which ordinary schools 
don’t have." 



C. PRODUCTION/DISTRIBUTION OF CAI MATERIALS 



1 . 


“Purely financial incentives will draw relatively incompetent 
people into the field. Attention must be given to maintaining 
professional standards." 


2 . 


“The pioblem of effective distribution of CAI materials and 
systems will resolve itself once theie is a market for such 
materials." 


3. 


“Local people are generally not qualified to write CAI materials 
nor would they have the necessary time. Results would be highly 




uneven in quality." 



I. Who are most likely to lx? the primary producers of CAI course 
materials* 



Academic facility .7 

Pi 1 vale sector, publishers. 

instructional materials producers, similar to textbook 

production .. 7 

Teams of specialists, or university-based labs .6 

A variety <»f sources J 







Agree ?3 
Disagree 5 



Agree 10 
Disagree 16 



Agree |2 

Disagree J* 



Agree ? 1 
Disagree _7_ 



Agree J 8 
Disagree 
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FILMED FROM BEST AVAILABLE COPY 



D. EDUCATIONAL SYSTEM AND THE TEACHER 


1. 


"Any CAI system which allows students to proceed at their own 
rate will create insoluble administrative problems for traditional 
schools." 


2. 


"CAI program development should be centered in schools so that 
teachers can actively participate in, and contribute their experience 
to. the development of ideas and programs." 


3. 


"CAI materials should be prepared with a sufficient number of 
options for the adopting teacher to sustain the position that his 
course is essentially under his own intellectual control." 



E. RESEARCH AND DEVELOPMENT 



1 . 


"CAI requires a great deal ol further development and study 
through disciplinary research and industrial development before 
it is refined enough for wide use," 


2. 


"Research considerations are very imi>ortant in the long>range 
view, but other factors arc of more immediate concern." 


3. 


"Instruction is still an 'art'; instructional theories arc irrelevant to 
making better materials." 



F. RE DIRECTION OF CAI 



1 . 


"CAI is too expensive now for any uses but specialized ones. 
More effort should be given to designing high quality CAI pro* 
grams for specific educational problems where CAI might be 
particularly effective, such as remedial education, reading, and 
calculus." 


2. 


"There should be more emphasis on learner control of subject 
material and style of teaching." 


3. 


'There should be more effort directed toward a computer-based 
system which would provide support for all the instructional and 
management functions in a school's program." 


4. 


'There is not enough leadership in the area of educational change, 
which is necessary if the potential of CAI is to be fully developed. 
National centers are needed to do research, to develop resources, 
to study policy questions, develop strategies, etc." 



O 

O 



6 



_Agrec 
Disagree 22 



Agree 14 
Disagree 14 



Agree 2J 
Disagree Jr 



Agree J6 
Disagree n 



Agree J7 
Disagree 6 

Agree 5 
’Disagree 20 



Agree 22 
Disagree J5 



Agree J7 
Disagree JO 



Agree j9 
Disagree 8 



Agree 22 
Disagree 6 
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A ppendix 3 

Convergence Data 



The response distributions of Question II items, over the three ques- 
tionnaires (Ql, Q2, and Q3), are summarized below. The items are 
numbered as in Q3, which is presented in Appendix I. The bars indicate 
the range for each distribution containing the middle 50% of responses 
(the interquartile range), with M indicating the median rating. 

Items which have only Q2 and Q3 ratings arc those which were first 
introduced in tire second questionnaire. 

R represents the number of responses which were more than one rating 
category from the median (M). 

Comparing Q2 to Ql, II out of 23 items decreased in R values (i.c., 
had fewer out-of-range responses), 5 remained the same, and 7 increased. 
Comparing Q3 to Q2, 31 out of 37 items decreased in R values, 3 re- 
mained the same, and 3 increased. 



A1: 



Ql 

Q2 

Q3 



1 


2 


3 


4 


5 








M 










M 





A2: 



Ql 

Q2 

Q3 



1 2 





M 






M 










A3: 





1 


2 


3 


4 


5 


Ql 








M 




Q2 








M 




Q3 






• 







4 

0 
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3 

4 

3 

3 

2 

2 

4 

6 

2 

8 

4 

0 

1 

3 

1 

6 

1 



ICO 



too 





D6: 




3 

4 
3 




D8: 




5 

2 



o 

EKIC 



\ 

A 



D9: 



Q1 

Q2 

Q3 



2 

M 


3 


M 




M 









5 

2 

0 



IOI 
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£2: 



Q1 

Q2 

Q3 





E3: 



Q1 

02 

03 




6 

5 

3 






10 ° 



fO 
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6 

6 

4 

3 

3 

4 

0 

0 

5 

2 

6 

7 
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Appendix 4 



Original Action Plans 



These are the unedited action plans suggested in response to Section 111 in Ques- 
tionnaire 3. They represent the major source from which the action statements 
(Appendix 5) were drawn. 

1. (I)t Thorough integration of CAI into a school curriculum will take (1) develop- 
ment of adequate materials, (2) revised administrative arrangements, (3) special train- 
ing for teachers, (4) cooperation of parents. As successful demonstrations will 
necessarily be of substantial scope I would favor working with a stute and one or 
more cooperating school districts. Enough funds must be provided to give adequate 
lead time, 1 - 3 years, and personnel. Potential benefits to be demonstrated are 
possible reduction in school costs, improved achievement, and greater flexibility of 
instruction. 

!• UNDING: Federal, State. Local - combination to yield approximately 

S 1 ,000,000 per cooperating unit per year. 

TARGET POPULATION: Typical schools. 

TIME PROJECTION: 5 -7 years. 



2. (1,5) The basic technology and techniques required for effective use of CAI have 
been sufficiently outliued through numerous relatively small ad hoc studies to indi- 
cate the need for major coordinated programs of research and development. It is clear 
that the parameters of the CAI system are as critical in determining its educational 
usefulness and economic feasibility as are the items of hardware and the computer 
programs. A small number of large scale projects should be undertaken which involve 
coordinated research and application of complete CAI systems serving a statistically 
significant clientele. The magnitude of such projects would require large commit- 
ments of funds for u period of several years. 



At least two projects shoutd be developed; one designed around maximum centraliza- 
tion of the information handling machinery with direct lines to each terminal, and 
the other emphasizing local computational units or “nodes" of computational 
machinery in an intercommunicating web. These projects should be undertaken 
through a consortium of industry, universities and communities, and directed initially 
toward markets of mass application and broad social need such as remedial elemen- 
tary education (reading, oral and written language usage, mathematics, etc.), voca- 
tional training in areas of projected need (service industries such as health care, 
mechanical maintenance, computer programming, etc.), ?.nd college remedial subjects 
(language facility, mathematics, etc.). These projects could be organized within five 
categories of activities: (I) system design, (2) hardware development. (3) program 
development, (4) operation, (5) evaluation. 

tThe numbers in parentheses refer to the related action statements in Appendix 5. 
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FUNDING: Federal grants plus industry U & D monies. $10- $15 million over 
a five year period for each projevt. 

TARGET POPULATION: 1st priority - Urban underprivileged children and 
young adults. 2nd priority - Other low income, jobless who need vocational 
training. 3rd priority - General primary and secondary school population. 

TIME PROJECTION: 5 years. 

3. _ (1) Support large scale demonstration of CAI feasibility- (NS P's current study 
with MITRE/TEXAS and Illinois). Two different, competing systems will be imple- 
mented, installed and used over a 5 year period, to evaluate the feasibility of each. 
Each system involves about 500 student consoles in elementary schools, junior 
colleges, and universities. Additional plans are needed for using these facilities, at the 
end of the demonstration, lor developing new CAI techniques - that is. for estab- 
lishing a kind of test bed in which new ideas can be tried. 

FUNDING: NSF, 5 million dollars. 

TARGET POPULATION: Across the board (formal education only). 

TIME PROJECTION: 1972-1977. 

4. (1) A third large (critical mass) demonstration is needed for instructional use of 
computers in college curriculum. 

U. of Illinois is developing and demonstrating the economic feasibility of a large-scale 
system; Mitre Corporation and the U. of Texas arc doing the same fora medium-scale 
system. Both are dedicating the planned facility to CAI (special languages, special 
terminal equipment, etc.) and pursuing new developments in hardware and software 
to gain cost savings. 

A third project should demonstrate the feasibility of extending general-purpose time 
sharing systems for economical assistance with instruction in colleges (and pre- 
collcgc?). It may be able to succeed in some aspects where the other projects are 
likely to encounter difficulties; it may produce software and curriculum which is 
more immediately useable on a broad scale. 

Part of the project (if it is all one project) would involve teleprocessing from a large 
system to senre a geographical region; part would demonstrate smaller time sharing 
systems readily rcproduccablc at new sites in a region; attention would be given to 
network concepts, especially to promote exchange among users, not necessarily by 
direct electronic communication. A group of universities and colleges would be in- 
volved, providing a broad base of expertise and experience. Innovation in curriculum 
development, combined with maintaining cost levels, would be emphasized, includes 
cooperation with professional societies to adapt materials for use throughout a large 
region (not typical regional computer services - “networks" - to date). 

FUNDING: $3 million; NSF. 

TARGET POPULATION: To demonstrate to college administrators and other 
decision makers that computing assistance can be effective and economical for 
college students, and may be especially important for students not having 
large-university learning resources otherwise. 

TIME PROJECTION: 5 years, including some diffusion activities. 

5. (2) Despite annual meetings and the beginnings of a community of users of 
computing, most faculty members on the fringes don't know exactly what it is like to 
bring computing into the curriculum. The project I propose would be a 'travelling 
circus' that goes from school to school, carrying terminals, plotters, mini-computers, 
and data acquisition equipment, and gives a thorough and realistic demonstration of 
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how teachers actually use a computer in their courses. 2 oj 3 days at each school 3 
or 4 faculty members, plus supporting cast in each troupe. Two months of action 
one of planning each year. 

I- UNDING: Federal, professional societies- $ 100,000 per year. 

TARGET POPULATION: Curious teachers. 

TIME PROJECTION: 3 years. 

6. (3) Develop a full CAI program for some subject, or educational level within a 
subject, in order to demonstrate, if it can be demonstrated, the intellectual and 
economic feasibility of the technique. It must be of the highest caliber and have 
maximum flexibility to enable the academic to sec his role as an individual with 
regard to the formatted curriculum. Then demonstrate the effectiveness of the CAI 
package m a real environment and with something of a fishbowl atmosphere from the 
perspective of bringing observers in for evaluation purposes. The package should be 
multi-media and interactive to the extent possible. The entire operation should be 
completely debugged and tested before it sees the light of day and scrutiny should be 
invited from the doubters. Above all, the demonstration should be significant, not 
gimmicky, and use the computer only where it has a real advantage over manual 
techniques* 

FUNDING: I) The Federal government - after all, it’s only a prototype of an 

educational SST. 

2) Foundations. 

3) A consortium of industrial grants. 

TARGET POPULATION: Academic peer group, school administrators. Iceis* 

la tors. * ’ 

TIME PROJECTION: 5 years. 

7. (5) Set up a cooperative project involving a community college system (Dade 
County, Fla., and St. Louis are good possibilities) and a major commercial producer 
of educational materials, with professional collaboration of retained outside experts, 
to develop,, test, and demonstrate a remedial course in English. ’Ibis is a basic and 
nearly universal need. Many community colleges and other open-enrollment public 
institutions are frustrated in many aspects of their educational program by the inade- 
quate reading comprehension, writing, and oral skills of their students. Correcting 
this is a Jlrst objective of nearly alt such institutions. They arc very receptive to new 
approaches. Because they do not recognize remedial English as a job they ought to 
have to do or want to do, ihere is no vested interest in existing methods. Any staff 
now engaged :n remedial English instruction would be glad to be relieved logo on to 
more advanced work. There is relatively little cake of custom to be broken. And 
community colleges are expanding rather than contracting and usually i)t * position 
to spend money for promising innovative systems and materials. 

Moreover, this is a field in which computer-assisted instruction seems to offer unusual 
promise. Hence the project combines social need, market responsiveness, teacher 
acceptance, and probable operational success. 

The project would design a course, prepare the programs and materials, including 
related conventional print and audio-visuals for follow-up and reinforcement, and test 
and refine them through two academic years. As success is achieved, in ibc second 
and third academic years the program could become a demonstration center in which 
the methods and materials could be studied for adoption or adaptation elsewhere and 
for guides as to techniques for programs in other disciplines or at other levels. 

Once the program had reached an appropriate and tested level of development, the 
participating educational materials publisher would be responsible for putting it into 
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final marketable form, producing it, and marketing it to community colleges, other 
open-enrollment institutions with comparable problems, and high schools. A part of 
the project, however, would be short, intensive teacher-training institutes to prepare 
faculty to use such materials. 

This project would be the most effective wedge 1 can think of to produce a solid and 
accepted success from which we could build out in a variety of directions. 

FUNDING: Federal grant (to community college system) and contract (with 
publisher) of approximately $750,000 to $1*000,000 plus contribution of 
services and facilities by the community college system and substantial invest- 
ment by the publisher. 

TARGET POPULATION: Community college entrants and high school 
students in need of remedial English. 

TIME PROJECTION: Two years for development, one for demonstration and 
production, one year or two for assistance in dissemination through funded 
teacher training institutes, 

8. (6) Let's assume we can cost-justify one modest computer in a fair-sized high, 
school or college. Let’s get as much payroll/invcntory on it as we can; let's tie it into 
vocational cd. and science cd. for demonstration purposes. Now let's design (a) a 
cheap time-sharing system for it, (b) use plasma display terminals, (c) get a team to 
design materials around this cost/capability constraint-set. For example, this means a 
limited number of terminals, used in shifts, perhaps with night school use as well, 
probably just one room with terminals, like the calculator room; probably students 
could be trained to do almost all servicing (vocational ed.). The big goal would be to 
increase efficiency. To do this we first need a very careful analysis of exactly what 
the computer can do that a programmed text can't do as well or ncarly-as-well-for- 
less, 

9. (7) Organize a national effort to create two or three alternative CAl programs 
aimed at the correction of reading deficiencies in elementary school children. Arrange 
for large-scale geographically dispersed trials of the course under teachers who have 
attended summer institutes on the course. Measure the time required by each student 
to attain a specified performance level, and compare that time with conventional 
course duration. Assemble complete cost-effectiveness data. 

FUNDING: U.S. Office of Education; private foundations. $2 to 5 million. 

TARGET POPULATION; Elementary school children with reading dif- 
ficulties, especially in urban minorities. 

TIME PROJECTION; Planning study (I year), course development and 
teacher training (2 years), and trials (2 years) ~ total of 5 years. 

10. (8) Support a special experimental demonstration program relating to the 
U.S.O.E. Right to Read program, and centering on the lack of functional literacy 
skills possessed by many inner-city, young adults between the ages of 16 and 25. A 
new Computer- Assisted, -Based, and -Managed Adult Education Success in Reading 
Program based on innovative hardware, newly-funded software development, and 
proven multi-media and learning psychology would be appropriate. 

FUNDING: U.S.O.E.: $5 million funding for 3-year program. 

TARGET POPULATION: The remedial open-enrollment city university 
group, plus Regional Opportunity Career Development Centers. 



TIME PROJECTION: 1972-1974. 



11. (9) Hie objective of this plan is to develop a computer-managed system for 
instruction in mathematics, grades 7-12. A school system would be identified and 
asked to submit behavioral objectives in mathematics for students in courses being 
taken in grade levels 7-12. The objectives would be arranged in Gagne type learning 
hierarchies. Sample test items keyed to these objectives would be cither randomly 
generated by the computer in Honeywell's Arithmetic Test Generator (ATG) program 
or they would be selected from pools of test items keyed to the objectives. A diagnos- 
tic and computer management system would be developed to build around these 
objectives. The interface with the computer would be with optical scan card readers 
located in the schools. Printed materials in quantity would be produced at a central 
location and sent on to the schools by mail. As the system develops* the learning 
materials being used in the schools would be adapted to the system and new materials 
developed where necessary. The school system should be willing to contribute hard- 
ware and software for the ongoing operation of the system with the funding of the 
project being utilized primarily for development purposes. Such a project would have 
a high probability of success because in the field of secondary mathematics is where 
the teachers have been most receptive to CA1. If a school system has an investment in 
money and faculty input into the system, there is a high probability that the program 
will continue after outside funding is discontinued. 

FUNDING: NSF or OE - $200,000 per year. 

TARGET POPULATION: Secondary mathematics students. 

TIME PROJECTION: Five years. 

12. (12, 26) Special education has high needs for individualized, highly effective 
instruction. Also has a deficit of teaching personnel. Program would have 2 phases: 

1) Development of courseware to train teachers in how to identify and prescribe for 
different conditions. 

2) Targeted courseware development for teaching the deaf to read and write (com- 
municate in writing or typing). Would develop basic knowledge of human info- 
processing in a pathological situation in which variables arc exaggerated. Product 
would meet tough social problems, add basic knowledge to programming for 
normals. 

FUNDING: Probably O.E. — $3.5 million for 4 years. 

TARGET POPULATION: Special Ed. teachers and handicapped students, 

grade 6 to adult. 

TIME PROJECTION: 4 years, 

13. (13) Begin with groups of high-school students who arc oriented toward teach- 
ing. Give them extensive opportunities to work with computers in their own instruc- 
tion and also in the development of programs. Let them participate in production of 
hardware* Follow up their interest and competence in their collegiate teacher training 
experience. 

FUNDING: Local and Federal, with possible industry subsidy. 

TARGET POPULATION: High-school students. 

TIME PROJECTION: Continuing program. Approx. 6 years for each group. 

14. (14) Support a special experimental demonstration program to prepare talented 
Job Corpsmen in the fundamentals of computer technology. The goal of the program 
would be career preparation for jobs as machine operator, junior programmer, etc. 
New, advanced concept multi-media software would be part of the development. 
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FUNDING: Department of Labor: $5 million funding for 3-year program. 

TARGET POPULATION: Male and female, GED level Job Corpsmen and 
Corpswomcn. 

TIME PROJECTION: 1972-1974. 

15. (15) Select a para-professional subject (X-ray techniques, police management, 
assistance programs for the aged) in which the objective is the acquisition of measur- 
able performance in the student. 

Organize a national effort to create a computer-assisted course in the selected subject. 
Engage the assistance of experienced teachers, and obtain the support of professional 
groups whom the students will serve after completion of their course. 

Arrange for large-scale geographically dispersed trials of die course under teachers 
who have attended summer institutes on the course. 

Measure the time required by each student to attain a specified performance level, 
and compare that time with conventional course duration. Assemble complete cost- 
effectiveness data. 

FUNDING: U.S. Office of Education; private foundations. $2 to 5 million. 

TARGET POPULATION: Community college and open university. 

TIME PROJECTION: Planning study (I year), course development and 
teacher training (2 years), and trials (2 years) s total of 5 years. 

16. (17) For a long time l*vc wondered if children would learn to read faster if they 
were provided with a restricted vocabulary and a set of typewriters which could 
communicate by pairwise interaction, through a central switching device. Restricted 
to typing messages to friends and reading friends* replies, that is, allowed to com- 
municate, but only by typing, they might learn to read very quickly (having an 
incremental expansion of the allowable vocabulary). It is an experiment that could be 
done relatively easily, and if it were successful, could provide a new mode of 
learning to read. 

FUNDING: I don*t have ideas about funding. 

TARGET POPULTION: 5 - 7 year olds. 

TIME PROJECTION: Experiment could be carried out in a few months, once 
hardware was constructed. 

17. (18) Appropriate CAI, using time-shared terminals, could provide the possibility 
of structured interaction between different classrooms in the same school, or even 
more important, different schools. This could be done through the use of computer- 
based games in which a class in one school would challenge a class in another school. 
The major problem to be overcome is the danger that participation would be limited 
to a few in each class. Consequently, the games would have to be especially well- 
designed, requiring contributions from every member of the class in order for the 
class to take its action on the terminal. 

Such a possibility as this could provide a good teacher with great opportunities for 
freeing the classroom from the constraints of the four walls and restricted interaction 
that currently characterizes it. 

18. (19) For several years, a limited use of simulation and gaming as a part of the 
education process has been made. Probably the most well known simulations arc the 
business games used in business schools and industrial management training courses. 
In addition, however, simulation has been used to teach strategy to military person- 
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net and to teach civics and foreign policy to secondary school students. Other uses 
undoubtedly exist of which 1 am unaware. Considerably more development is needed 
to exploit the possibility of this approach to using computers in education. It is my 
belief that simulation represents the single most powerful use of the computer in 
education. It is the only area of which 1 am aware in which the computer can provide 
a depth of understanding impossible by any normal teaching method. 1 suggest that a 
task force be established, probably under the direction of the US Office of Educa- 
tion, to establish a strategy for the development and exploitation of the use of 
simulation. Results should include a list of projects which the computer industries 
and educational researchers should be encouraged toundertakc, 

FUNDING: The only additional funding required would the cost incurred 
by the USOE. Therefore, projects should be funded by the participants based 
upon market justification or justification as a valid educational research pro- 
ject. 

TARGET POPULATION: Students at all levels with the greatest emphasis at 
the secondary school level and above. 

TIME PROJECTION: The strategy and planning effort should begin im- 
mediately with the computing industry encouraged to market resulting prod- 
ucts as soon as feasible. 

19. (21) Effort is needed in the “applied** research area of testing the relative effec- 
tiveness of various pedagogical techniques (drill and practice, simulation, tutorial, 
etc.) that are computer-based in relation to the material to be taught. Clearly dif- 
ferent techniques have differing degrees of effectiveness depending on the degree of 
structure inherent in the material, the material's complexity and the like. On top of 
these two factors of course there is the question of the style of the student and the 
impact this has on the methods of learning that arc most effective for him. The goal 
of the project would be to do enough experimenting to understand the dimensions of 
these three factors so we would be in a position to design tlie more effective CAI 
systems. 

FUNDING: Foundation or Government - $200,000 per year for 3 years to 
tfach of 10 universities. 

TARGET POPULATION: University undergraduate or masters. 

TIME PROJECTION: 3-4 years. 

20. (22) What is essential is not to ask how CAI can become more widespread, but 
what are the central problems of education now, and how can CAI contribute to 
their solution. 

One central problem is the fact that elementary and secondary schools arc now used 
largely as custodial institutions, and this, coupled with decreasing opportunities for 
responsible action outside the schools makes students far more irresponsible than 
they would otherwise be. Whether CAI can contribute to the solution of this problem 
(which manifests itself as “discipline problems'*, teacher dissatisfaction and loss of 
control, and race-related disruptions in schools) is not at all clear. But an effort 
should be made, because if successful, this would contribute to solution of major 
school problems. 

One possible direction involves the combination of individual student-paced learning 
on CAI in which the completion of a specified task or unit is not merely followed by 
more of the same but by a different kind of activity, which would be student- 
selected. Th* general idea is that when a student completes a certain amount of work 
(i.e., reaches a certain achievement level), he gets the possibility of using his time 
much more fully at his own discretion. He still must make his choice from among a 
certain set of activities that contribute either (a) to his own learning; (b) to :Jic 




school's corporate goals; or (c) the community’s welfare. Tills freedom and oppor- 
tunity to act responsibly should provide the incentive to proceed rapidly in the 
self-paced learning. 

This would imply two kinds of organization of the school. In one, the teacher's role 
is reduced to that of monitor and aide, to help out when and where problems arise 
widi self-instruction. At die same lime, most teachers would be leading activities of 
types (b) and (c) above, either those which contribute to the school's goal or those 
which contribute to the community's welfare. 

21. (23) There is a need for basic research into the question of how humans learn. A 
project of direct operational use to those in the CAI field is the development of a 
model of the learning process. If we are clear on the major variables involved in how 
people learn then we have a base from which to design systems tha* will improve that 
process. Tills is obviously a hard task but one that may be tractable if wc view it from 
the standpoint of a learning model to give us insight into ihc uses of CAI, rather than 
a completely general purpose model, 

FUNDING: Foundation or Government - $500,000 to $1,000,000 per year 
for 5 years to 3 or 4 universities. 

TARGET POPULATION: - 

TIME PROJECTION: 5 - 6 years. 

22. (24) 1) To conduct research on basic problems relating to the generation of 
instructional materials and tests by a computer with minimal input demands on the 
author; 2) to relate these findings directly to the development of courses and areas in 
which the effectiveness of the materials can be evaluated; and 3) to conduct a 
cost-benefits analysis of the results. 

To illustrate the approach assume that the objective to be achieved by a lesson was to 
teach a vocabulary (technical or foreign). The author would be required io input his 
data base - the terms and definitions - and a set of parameters defining the form of 
presentation and conditions of learning. E.g., dropout procedure, correction (limit 3), 
80% criterion (no misspellings), 12 word lists. The system would operate on his 
database and produce a CAI program as specified without further work by the author 
and without the need to “debug." Gagne's eight types of learning tasks would be 
used to provide the taxonomy used in developing each of a set of eight generators, 
one per type of learning. Each generator would allow the author Options and, where 
data permitted it, the options would be selected for inclusion on the basis of data 
reported in the research literature. Other aids would preside “rcadibility" analyses of 
text so materials would be graded for difficulty and guides to authors so they could 
reduce the level of difficulty to fit the targeted students. Tests would be generated 
from text. 

FUNDING: NSF or USOE, $175,000 to $200,000 for 5 years. 

TARGET POPULATION: Health sciences and teachers in the health sciences, 
including paraprofessionals. 

TIME PROJECTION: Five years. Each of the three efforts - lesson generator, 
analytical tools, and test generator - would be developed concurrently but 
not at the same rate. Each, in order indicated, would be completed in a cycle 
for each of the eight types of learning before the next set was developed. Cost 
benefit analysis would be performed upon the completion of a set of lessons 
involving each of the eight types of learning. Two types of learning would be 
completed in each of the first 3 years and the last two types of learning would 
each be completed in the fourth and fifth years, respectively. 

23. (29) Students and administrators have demonstrated considerable interest and 
acceptance of CAI; teacher interest and follow-through is low. There is need for 
intensive teacher training, 
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ft) as part of preparation - on an optional basis, 
b) in-service training. 

The NSF model of summer workshops would probably be most effective, but short 
term school system sponsored courses could he just as effective and would demon- 
strate (to the teacher) the system's interest in CAI work in classroom. 

FUNDING: Summer programs - probably state or national - (NSF). 

TARGET POPULATION: Classroom teachers - minimum of two per partici- 
pating school ( not system) building. 

TIME PROJECTION: Could and should be started now and continue with a 
scries of programs moving into advanced. Could effect students within a year 
as teachers and trainers. 

24. (30, 88) Attempting to work with individual schools on an experimental basis 
(with or without government subsidies) to reassure teachers, learn their true concerns 
and meet them would be pronging. Perhaps this has already been done. A few 
striking positive demonstrations of meeting teacher and institutional resistance ought 
to be most worthwhile. 

25. (31) Establish a scries of in-school demonstrations - training centers throughout 
the country. The centers would be two-purpose: I) practical demonstration of effec- 
tive CAI with elementary and secondary school students, 2) training centers for 
teachers from other schools who could see practical application of the techniques 
they are expected to team and take back to their own schools. I would favor training 
a team (teachers and administrators from a school or school system). 

FUNDING: Demonstration centers would require national funding but could 
possibly charge tuition for team training. 

TARGET POPUMtfON: a) teachers and administrators for training, b) 
general public In <.?rru? of publicity for effective programs. 

TIME PROJECTION: I year to establish (effect & upgrade) demonstration 
centers. Programs couM then be continuous. 

26. (36) Fund a project which would place a small computer at the disposal of a 
single elementary school. A program of individualized instruction youtd be instituted 
throughout the entire school. The computer would be employed to assist in helping 
the school implement the open, individualized setting. It would be concerned with 
branch testing for diagnostic and assessment purposes, with management information 
for the students and teachers, for making instructional decisions on the next steps to 
take, and would also be used for instructional FnrpoSes alongside standard teaching. 
This project would show the intensive use ?.f a computer in a total school effort to 
redesign education. 

FUNDING: $500,000 a yfral* 

TARGET POPULATION: t»rv t'.WwK 

TIME PROJECTION: Six 

27. (36, 37, 38) The design, testatg arid evaluation of an effective, practical and 
economically viable educational system on a prototype basis should be undertaken 
and financed by the Federal government - with congressional approval and a long 
term commitment to its successful completion. I would assume the cost of such a 
program at approximately $100,000,000 and the time required as 5 years. 

28. (36, 37, 38) CAI cannot be demonstrated in a traditional school setting because 
no school is organized in ways which permit evaluation of the characteristics of CAI. 
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All of (he operational characteristics of CAI which arc cost effective outside of the 
educational setting turn out to be irrelevant in schools, The details to support this 
position arc found in two very important articles: Randall & Blaschkc "Educational 
Technology: Economics, Management and Public Policy," Educational Technology \ 
June 30, 1968; pp. 5-13, and Kopstein "Why CAI Must Fail!", Educational Tech - 
nology, March, 1970; pp. 51*53. 

If these descriptions of the situation arc accurate, then any further "demonstrations" 
of CAI in schools are pointless. Instead, we should be experimenting with our ability 
to organize and administer schools so that the cl laraetcri sties of CAI can be mea- 
sured. Tli is would require designing a school from the ground up. it would entail 
developing an enormous body of curriculum heforc the first class could enter. The 
operation of such a new school would include the following features: 

1) Each student would progress through the school as a function of the courses he 
completes regardless of the time he requires to do so. 

2) Every course taught in the school will include some CAI elements, although the 
ratio to other course activities will vary widely from course to course. 

3) Each course grade will depend at least partially on student performance on the 
CAI elements. There will be absolutely no pressures to grade on a curve for fear of 
". . . giving too many A V* 

29. (39) I just don’t have a "master plan** for launching CAI to the benefit of 55 
million students. Indeed, I don*t even have a feeling for how much money would be 
needed to demonstrate that CAI could be a cost-effective means of educating many 
of these people. 

My fear is that CAI, like the moving picture, the radio, and television, will ascend like 
a rocket, burn out, and descend to earth - just another device that held such early 
promise for better learning but could never work its way into the American school- 
house and into the habits of the American teacher. 

Let’s face facts: Tester? possess the territory. Any device that suggests technological 
unemployment tfrtously alters professional practice, will encounter well-meaning 
hostility. RecAVti;4 will improve in proportion to the extent that the teacher's 
capability ^nUrgcd, Tit Accomplish this the role of the teacher has to be changed 
a's„j u alike Outness and industry, hasn't the resources and sometimes the 

inclination tc retain It? people in any fundamental way. 

Assuming that CAI \!an extend the teacher and increase his productivity, it is unfor- 
tunate that the costti of whatever is new become add-on costs, not trade-off costs. 
This is the dilcmtra and it may take years to switch from add-on to trade-off. In the 
long run, thought fhd is the hope, CAI must aw^ait the reorganization of education 
itself before a substantial market can be secured. Asa target for early entry, I would 
jtucss that the American home will be a better market than the American school. 

If I were pressed to designate what sector of education would be most responsive, I 
would say "the new towns." Over 200 new towns are how in some stage of planning 
or construction in this country. These new towns frequently have no history, no 
constituency, and no established ways. They arc free to strike out on their own to 
teach their people - not just children - in more effective ways. A demonstration 
mounted in a new town can have credibility among the 17,000 school districts that, 
though autonomous, nevertheless desire to catch up with the state of the art once 
somebody has demonstrated it. 

Forget the big cities — unless Federal funding is assured and sustained. Forget 
suburbia - they have enough money to buy the best teachers and run the smallest 
classes. Forget the hustings, for they are so close to marginal survival that any 
expenditure beyond textbooks and band uniforms is politically beyond their grasp. 
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The new towns though arc reaching for better ways. In this setting. CAI has a chance 
to prove itself, especially if the learners arc persons of all ages wherever they niav he, 
and not just children locked for a few years in something called a schoolhouse, 

Historically, education is a receiver, noi an initiator of invention. With the coming of 
CATV and other ways of floating information from people Who have it to people 
who want it, the prospects of CAI improve. And as homes and businesses and people 
generally come to profit from CAI, the chances increase that CAI can get through the 
schoolhouse door. 

Nothing in the above should be construed as placing the blame solely on education 
and educators. There is enough blame for everybody. 

30. (41) Techniques for leasing or joint use by school groups might aid in reducing 
costs and providing adequate tests as to “cost effectiveness.** 

31. < 48 ) Set up four or so regional centers in universities in different parts of the 
country. Bach location should have 1) a timesharing system or systems available for 
large scale student use. 2) philosophy that encourages such use, 3) faculty members 
with strong discipline oriented backgrounds who have already begun to use com- 
puters in teaching and learning situations. Faculty, local and visiting, should be 
attached to the center for periods ranging from 6 months to 2 years, first developing 
materials (with no restrictions as to the type and amount of computer usage) for 
innovative approaches to their areas, and then using these in full classes and revising 
them based on this usage. Emphasis should be on modules usable in or out of 
ordinary classes, looking toward such concepts as die open university. Programming 
support, etc. would be provided, but the primary function would be to develop 
discipline oriented teaching materials rather than software. Each school should have 
an available general purpose computer, different in school to school. At least one of 
the groups should be oriented toward graphic terminals. Five year life, about 6 
faculty members per location. Several national meetings each year involving all 
centers. 



FUNDING; $200,000 for personnel, each location, each year, plus $30 000 
for computer time and $50,000 for travel, etc. $280,000 x 4 centers x 5 years 
* about $6 million. Federal funding-O.E. and NSF. 

TARGET POPULATION; Colleges, universities. 

TIME PROJECTION; Five years. 

32. (49) Set up training laboratories, possibly run jointly by teacher training institu- 

tions and textbook publishers (or the CAI equivalent), for authors and supporting 
technical teams. 6 

FUNDING; Public and private, with industry subsidy. 

TARGET POPULATION; - 
TIME PROJECTION: Continuing. 

33. (50) Establish a number of discipline-oriented centers for production of course 
materials that support the use of computing within the curriculum. Authors would 
come to the centers to work full time on production of materials. Centers would give 
editorial and programming assistance, salary, expenses. Centers would publish, adver- 
tise, distribute completed monographs, books, programs, etc. Centers would organize 
travelling circuses to take materials to schools and show them off. Centers would host 
training institutes for interested faculty. 



FUNDING: $300,000 per year per center. Sources - mixture of Federal, 
professional societies, commercial publishers. 



\ TARGET POPULATION: Teachers who decide course content and curricula 
at their institutions. 

'^TIME PROJECTION: 3-5 years duration, starting now'. 

34. (5 V) Subsidize discipline-based groupings to. develop curricular materials em- 
ploying \thc crfnputer extensively, but not exclusively. Begin with lower division 
course; Vfl topiifc with large demands and high computer relevance; c.g., economics, 
business, engineering, computing, modern languages. Require that materials be dev-eh 
oped in a -way that enables wide-scale distribution. (Rely on activity described under 
action plai\ 11 to provide means of distribution~#22.) Arrange for royalty payments 
and credit to individual authors. 



FUNDING: NSF, OE, N1E (when authorized): $1 million/year per subject. 
TARGET POPULATION: Lower-division college students. 

TIME PROJECTION: 3 - 5 years. 



35. (51) 1 would proceed on two fronts. 1) The development of discipline task 
forces, or educational level task forces that would develop a CA1 prototype in a 
particular field of work and proceed to demonstrate to their colleagues around the 
country the quality and feasibility of the endeavor. In short, build a better fhousetrap 
and proselytize. This requires institutional cooperation and brownie-point 
tion and probably must be done on an inter-institutional basis. 2> Seek general 
recognition of the priority status needed for the application of technology to educa- 
tion, Make quality education a national goal - like going to the moon. 



FUNDING: Massive federal and fouiidaTion support perhaps coupled with t«V 
incentives or other forms of subsidy. 



TARGET POPULATION; Academic peer group for each taskforce. 
TIME PROJECTION: 4 - 8 years. 



36. (51) Support multi-disciplinary applications of the computer (areas such as so- 
cial studies, science, business, industrial arts, ma the mattes). A team consisting of 
computer specialists, simulation specialists, and educators would work with master 
teachers to identify areas where the computer can be effectively used within the 
curriculum of. the present and foreseeable future. Simulations and other activities 
would be developed that could easily be implemented to expand student horizons 



FUNDING: NSF or OE - $200,000 per year. 

TARGET POPULATION: All secondary students. 

TIME PROJECTION: Five years. 

37, (53, 61, 62) Establish incentives (and supporting procedures and resources) for 
more effective development, documentation and exchange of computer-related learn- 
ing materials. 

Establish standards for documentation (including validation). 

Develop guidelines for development, testing, revision, exchange (c.g., using someone 
elsc's materials, perhaps with modifications). 

Establish procedures for obtaining credit for materials development (clearinghouse, 
national index, reviewing procedures for professional journals, classification, etc.) 
with special attention to encouraging improvements in materials (a step up a ladder 
indicating quality and usefulness, reflecting academic records and opportunities for 
economic recompense). 
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Make it easy for one to find out about available materials (at different levels of tested 
usefulness), to try them out. to adapt them for local use. and to report results back into 
the clearinghouse data bank. 

Fsed the information and procedures of this national incentives system into the 
training programs, both in-service institutes and regular academic programs (including 
programs for teaching fellows in universities). 

FUNDING; NSF and OE. $500,000 over three years. 

TARGET POPULATION: Authors and users of computer-related curriculum 
materials. 

TIME PROJECTION: Some small and favorable influence in fitit two years, 
beginning to show results in third year. GcaringhoUsc should become self- 
supporting, and standards and guidelines maintained by committees associated 
with professional societies and accreditation institutions, but some follow-on 
funding may be needed to carry forward effectively for a few years. 

38. (54) To produce a thorough revision of the content of education is a major 
intellectual undertaking. It will happen — and indeed, in a small way is happening. 
But its rate of progress will depend unprcdictably on its ability to fire the imagina- 
tion of crca.ivc, energetic people. Unfortunately this is not happening except in a 
desultory fashion. "C.A.I.” as an area of intellectual endeavor has a public image of 
drabness and mediocrity. This is certainly a most important factor responsible for 
inhibiting the widespread use of computers in education. I believe that the most 
effective action that could be taken now is to create conditions for research that will 
stand some chance (there can be no guarantee!) of competing with the more “glamor- 
ous** areas of intellectual endeavor for people of the highest caliber. 

An example of a practical step in this direction is creating a research institute (or 
several!) with facilities for several experiments on the scale of providing groups of 
children with unlimited access to computers over a period of several years, of freely 
experimenting with new computer controlled devices, of being able to set up teams 
of trained observers to track the progress of individual children, and so on. It is 
important that such an institute bo able to separate the pursuit of fundamental 
knowledge front the economic and practical problems of applying the outcome of its 
research on a large scale. It is important that it have the means to attract visiting 
scholars, graduate students and, of course, its own faculty. To do this would cost 
between seven and ten million dollars for the first five years, which I sec as the 
minimum viable period for guaranteed support. 

I strongly suggest that the EDUCOM study should propose the creation of I or 2 
such Institutes, and should immediately concentrate on sponsoring the production of 
several detailed proposals for discussion. 



39, (54,55.66) Establish an IritvidiscspHnary Center for Educational Development 
and Change in which CAI would be used in its own instructional programs (extensive- 
ly but not exclusively) and with special emphasis given to the use of computer-based 
systems as instruments for change in curriculum, the role of the staff (especially the 
teachers) and in the assessment of individual development. The three training pro- 
grams would be: (l) team training of interdisciplinary teams in the complete develop- 
ment cycle (planning through summative evaluation) for instructional program devel- 
opment; (2) individual training of managers of development and delivery systems for 
instructional applications; and (3) individual training of evaluators and researchers in 
the evaluation process from planning to summative evaluation, including testing and 
data processing, not only for personnel evaluation but also for cost-benefit analysis of 
systems and approaches. All three programs would be run concurrently and would 
continue throughout each year. While each would have its own primary staff, some 
personnel would be shared to achieve economies. Administration of the center would 
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be in the Division of Educational Research and Dpvelopincnt, SUNY at Stony Brook, 
which, among other administrative units, lias an IRC (Instructional Resources Center) 
for materials development and with its dedicated CAI system, a Center for Continu- 
ing Education which offers courses at the graduate level to the community, and a 
Department of Education. Harvard case study approach would be used extensively. 

FUNDING: USOE Personnel Development and US Public Health, Manpower. 
$200,000 per year for 24 students (8 per program). 

TIME PROJECTION: Seven years with 24 the first year and modes! incre- 
ments in the numbers in succeeding years resulting in training approximately 
175 people at the masters level and approximately 20 in all three programs for 
doctoral level which also would include a dissertation. Since only 3 to 5 would 
recycle from each graduating class, there would be approximately 20 people 
available for employment each year. 

40. (56) There is abundant evidence that CAI in its various forms can effectively con- 
tribute to college, post-graduate and professional education. In institutions of higher 
education, failure to conduct more broadly significant and effective CAI innovations 
lias been in considerable part due to lack of faculty incentive. This lack of incentive 
results from a variety of factors and is evidenced in many aspects of faculty endeavor- 

1) Lack of reward Most of the lack of progress in educational innovation and 
improvement results from this cause. In contemporary academia, the faculty com- 
prising the major universities receive very little professional, economic, cartel, or 
personal status reward for teaching; particularly undergraduate teaching. Despite 
virtuous — and entirely sincere - declarations on the parr of both the faculty and 
the administration to increase the valuation of teaching in appointment a*d pro- 
motion procedures, little revision actually occurs. Inertia and difficulty ofobjev 
live evaluation arc of small significance in explaining this failure compared to Utc 
national ambience within the academic community which decrees that research 
and scholarly activity recognized on an international scale arc the only significant 
indices of professional success. Until this generally pervasive value system is mod- 
ified, no single institution, however prestigious, can by decree greatly redirect the 
activities of its faculty. 

2) Lack of knowledge. Most of the faculty comprising the major universilies arc 
professional scholars, but amateur teachers. They have had nb education in the 
field of education except the experience of their own education. Furthermore, 
they generally - and not without some justification - disdain the organized 
discipline of “Education” as represented by traditional Schools of Education. 
Most faculty tend to perpetuate the historical techniques and intuitive convictions 
characteristic of their own education because they are largely unaware of that 
body of knowledge from which they could rationally design more effective and 
efficient educational programs. 

An example of one of the more defeating convictions among some faculty is the 
belief in the essential mysticism of the educational process; that a mysterious 
effluvium flows from the teacher to the student through which the student ac- 
quires the most significant elements of his education. This effluvium can, appar- 
ently, only be transmitted through air and across short distances. It is blocked by 
any mechanical or electronic contrivance and also is destroyed by any attempt to 
analyze the student's educational goals and needs in terms of his eventual role in 
society. This concept inhibits more rational attempts to define educational goals 
in operational terms, and prepare programs and tests to accomplish these goals 
most effectively and efficiently. 

3) Lack of leadership. Since very few rewards accrue to the full time dedicated 
undergraduate teacher, creative, charismatic leadership docs not arise. In addition, 
it is a cherished conviction among most faculty that each is equally expert in the 
educational process; or at least that each must be allowed to pursue his individu- 
al convictions toward the instructional process. 



Nevertheless, the faculties of the nation's universities comprise a primary resource of 
expertise necessary for the development of CAI, and the universities themselves arc 
fertile sites for testing various types of CAI programs. Universities often have primary 
and secondary level "laboratory schools'* associated with their departments of Edu- 
cation in addition to their college, graduate and professional academic programs. 
Many universities already have sizeable computer facilities and large number; of 
personnel skilled in all aspects of computer use and design. The primary need is to 
engage a sufficient number of appropriate faculty in CAI development as a first 
priority task. With a few notable exceptions CAI experiments within universities have 
been desultory and disappointing, due to general faculty apathy and lack of reward. 

To modify this situation will be difficult, but I propose that Federal grants be made 
available to universities - not to individual faculty members - for CAI research and 
development and that their use be rigorously subject to the following requirements: 

1) First priority commitment of an interdisciplinary group of faculty to project. 
Grant should provide salary support for these faculty and require full time com- 
mitment (with full time salary support) from principals. 

2) Guarantee from the University that the faculty involved in this project will have 
their project related work evaluated for promotion as equivalent to scholarly 
contributions in a conventional discipline. 

FUNDING: Grant amounts would vary according to project, but to insure a 
sufficient magnitude of commitment, $500,000 per year for a period of three 
to five years should not be considered excessive. 

TARGET POPULATION: Varies with project from primary' and secondary 
level to professional. 

TIME PROJECTION: Varies with project up to five years. 

41. (63,64) Experiment with and refine the teehnological capabilities of the three 
computer system approaches that offer a chance of promoting in ter-ca inpus exchange 
of instructional materials: 

1) centralized time-sharing systems 

2) decentralized minicomputers with cassette programs 

3) networks with 2) as terminals communicating as access with I). 

Emphasize the requirements for exchangeability of materials! 

FUNDING: NSF, State HE Authorities, OE, National Institute of Education 
(if authorized). $1-10 million for development. Some operating subsidies, but 
most costs should be covered by schools. 

TARGET POPULATION: Higher education. 

TIME PROJECTION: 2 - 5 years. 

42. (67) 1 do not think the evidence warrants any actions to further the growth of 



43. (67) WAIT. DO NOTHING. Institutions which see a need will proceed if they 
can find a way. Let them compete for funds that are not earmarked for CAI. Where 
problems are soluble they will merit investment and will get it. There arc too many 
uncontrollable forces at work - too many proven educational projects and products 
which deserve funding ahead of CAI. 

44 (71) All too often research and development work in CAI has failed to distin- 
guish between two basic issues: the first is adapting the computer to the needs of 
education and, second, improving educational processes, now possible through the 
use of computers. Unfortunately, the first issue has often been overlooked in favor of 
the second. Wc have attempted to address the issue by saying, “now that we have the 
computer, we can save education.” This Is definitely not a realistic approach. Early 
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uses of the computer in other industries altered the process of those industries at 
most only slightly. Only after a great deal of experience with computers existed and 
after many processes were implemented on a wide scale with computers, were basic 
changes instituted. A good example is the banking industry. liven today after a 
decade and a half of the use of computers on a wide scale, demand deposit account- 
ing, still remains much the same, with the checkless and cashless society remaining a 
futuristic idea. The analogy in education suggests that we arc guilty of trying to 
implement the cashless and checkless society rather than first simply trying to adapt 
the computer to the needs of education as we now know it. Emphasis, therefore, 
should be placed upon accepting the various aspects of education as they now are* 
and using the computer to improve the present processes. Where the computer can be 
used as an aid to the teacher or administrator, this should be explored. If drill and 
practice can be done by a computer in a way that directly aids the current process, 
this should be explored. In short, I suggest that emphasis be placed upon accepting 
pedagogy as it is today and upon using the computer to aid the present processes 
rather than emphasi/.ing the redesigning of education so that it will best fit the 
computer. 

45. (73) One of the basic problems with the acceptance of CAI on a wide scale in 
education is that CAI systems lo date have largely been designed for a relatively small 
number of students or for research purposes or both. It is now necessary that a 
“production outlook” be adopted. That is. research and development should concen- 
trate on serving the needs of a large number of students with much more efficient 
systems. This must be done even if some flexibility is sacrificed. Educational re- 
searchers tend to concentrate on pedagogy and very careful evaluation of educational 
approach. Much of this work has been done and documented as it relates to CAI. On 
the other hand, very little work has been done with those in education that have the 
“production** education problem. Emphasis, therefore, should be placed upon relat- 
ing future development activity directly to the problems of the “production” educa- 
tor. Superintendents of schools of large cities and administrators of community col- 
leges are both good examples of individuals with ‘'production” education problems. 

FUNDING: Since what is being recommended here is a Matter of emphasis 
rather tluin specific projects, there is little or no funding required. Ideally, this 
emphasis should be placed upon the educational community by the US Com- 
missioner of Education. This emphasis can be supplemented by reports in 
educational journals, and other publications. 

TARGET POPULATION: Educators, educational publishers, and those in- 
volved with educational applications in the computing industry. 

TIME PROJECTION: Immediately with period reinforcement in the fulto*:. 

46. (76) Any attempt to program for tutorial or dialogue CAI quickly runs into the 
difficulties of processing students inputs - responses or questions - ex’ptttaed & 
natural language. Ideally, the CAI course author should be able to pose a question io 
the student, specify a model answer, and instruct the processor to at *:ept a* correct 
that answer, or any answer whose meaning is the same. What is needed is the develop- 
ment of a program which will perform this semantic analysis and provide the CAI 
processor with the result. 

While this is a formidable requirement, the implementation of any approximation to 
it would constitute a significant breakthrough for CAL It would allow us for the first 
time to lift the various artificial restrictions on student inputs which only degrade the 
teaching effectiveness, and limit the scope, of CAI programs. 

FUNDING: On this and the time projection, an expert in linguistic analysis 
should be consulted. Bernard Spolsky, Indiana University, was deep into this 
problem in 1965, and could provide a far more accurate projection. 

TARGET POPULATION: Not too critical; 8th grade or over. 
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47. (76) A general program of grant support is needed for development of CAI 
techniques, especially those devoted to providing more latitude for the student. 
Proposals would be evaluated in typical fashion. The emphasis would be on 
enhancing the capabilities of the computer (which has often been called artifical 
intelligence, an awkward term). 

FUNDING: NSl ? Office of Computer Activities - Initially Vi million per year. 

TARGET POPULATION: Applicants would probably be from universities and 
research laboratories. 

TIME PROJECTION: Indefinite — 10 years at least. 

48. (77) A number of recent studies have began to yield results in CMI. Here instead 
of the computer directly interacting with the student, the computer is used as an aid 
to the teacher, usually in the normal teaching process. Several computer guidance 
counselling systems have been designed and are operating. More than 20 different 
unrelated efforts are underway experimenting with the use of data banks. These data 
banks contain test quertions or lesson planning material or, simply, resources. In the 
use of test question data banks, for example, quite elaborate systems have been 
designed to enable the fully automatic preparation of tests, the grading of these tests 
and the maintenance of statistical results. Our primary interest in all of these 
examples is the fact that the cost per student is much lower than is true in tutorial 
and drill and practice CAI. In some cases, the cost difference is as mudi as two orders 
of magnitude. A task force should be established, probably by the US Office of 
Education, to develop a strategy for the thorough exploration and development of 
CMI applications and to coordinate the implementation of this strategy. 

I* UNDING: Funding for these projects should continue to be the responsi- 
bility of those undertaking them. This is true of both industrial and 
educational institutions. Where joint studies are desired, each participant 
should fund his own portion of the effort. The strategy task force and 
coordination effort recommended above should probably be the rcsponsiblity 

TARGET POPULATION: Since, by definition. Computer Managed Instruc- 
tion is designed to aid teachers, the target population is teachers and 
instructors at all levels of education. 

TIME PROJECTION: The strategy and coordination effort proposed above 
should be begun immediately. By the end of its first year, it should have 
succeeded in identifying existing projects and recommending new projects to 
cover the wide rangfl of computer applications possible. Since cost constraints 
are so much less severe than in most of today's CAI applications, it is my 
belief that the market exists now for CMI applications. 

49. (78*79,81) Organize project to develop one or several educationally oriented 
terminals: 

1) As inexpensive a terminal as possible— using existing technology and production 
wherever possible, planning on the basis of large-scale use in the future. 

2) General purpose terminals, for use of existing general purpose computers - 8 bit 
code, ASCII, etc. 

3) Many options -graphics, slides, audio, tablets. 

4) Variable character set, controllable in program. Every area has its own symbolic 
requirements. Authors should be able tu use any characters needed for natural 
presentation of material. 

5) Hardcopy options forj groups of graphic terminals. 

6) Great attention given to physical design of terminal and associated environment 
to make it as effective as possible in the teaching situation. Use very competent 
industrial designers with long-range interest in design/education interaction, such 
as Charles Eames. Should include design of rooms for groups of terminals and 
associated devices, such as hard copy. 
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Design team should involve industrial designers, innovative engineers, teachers, 
students, use market analysis techniques to tes* preliminary designs with a wide range 
of students. 

FUNDING: Try to obtain support froin a group of vendors - manufacturers, 
distributors. 

TARGET POPULATION: All educational vipers. 

TIME PROJECTION: Five years. 

50. (78) Many, if not most, computer assisted instruction programs actually utilize 
only a tiny fraction of the capacity of the central computers by which they are 
serviced, which involves wasted expense. If there were available access to an adequate 
data bank and encoded programs in other forms, art extremely simple digital 
computer could perform the necessary operations in receiving and interpreting the 
student’s responses and in selecting for display or other transmission the next 
instructional unit or sequence. It might be possible to build such a limited computer 
capacity into a self-contained terminal having both CRT and keyboard facilities, and 
provide access to a data bank by continuous retransmission of the data banks content 
by cable. The total content of an adequately large data bank could be circulated 
dozens of times a minute by cable, so that tjie computer unit in the terminal could 
select the needed elements almost instantly. 

This is beyond my expertise, but I am told that such a terminal and system are 
theoretically quite practicable. If they could be developed, it would permit CAI uses 
in institutions without access to expensive central computer installations and would 
greatly increase the range and flexibility of the techniques. 

The project would be a research contract by the Federal Office of Education with a 
firm competent to design, create, and test the proposed hardware and system. 

FUNDING: Federal. 1 am not in a position to make an informal judgment as 
to amount, but I would guess for research development, and testing expenses 
through the production of a working prototype it would be on the order of 
$500,000. 

TARGET POPULATION: General. 

TIME PROJECTION: Three years. 

51. (80) The combination of cable TV plus time-sharing computers plus specially 
designed terminals has already been demonstrated to be cost-effective. The work is, 
however, so far only in its beginning stages of development. Several R & D efforts 
should be studied to design the best combination of equipment for both institutional 
and home use. An appropriate team might consist of a computer specialist, a 
communication technologist, a systems engineer, and an educational expert. 

FUNDING: Office of Education, NSF - $1,000,000 for up to four beginning 
efforts. 

TARGET POPULATION: - 
TIME PROJECTION: I - 5 years. 

52. (82,83) Several research and development projects should be established aimed 
at the possible redesign of drill and practice and tutorial CAI. Projects should 
include: 

I) Thorough systems analysis of CAI as it might apply to large numbers of students 
without completely altering today's education systems. Emphasis should be 
placed upon minimizing system cost if necessary at the expense of flexibility and 
added function. 



2) The design of those special computer terminal features required by education and 
more or less unique to education. These include random access audio capability 
for use in leaching reading and languages and computer controlled video cassette 
capability to lower the cost of storing and presenting large quantities of 
educational material. 

3) A task force made up of representatives of the computer industry, the publishing 
industry, and education should be convened to address the materials of 
instruction problem. This effort should be coordinated with the redesign of CA1 
outlined above and should be charged with determining responsibilities of each of 
the three institutions represented in successfully making available quality 
materials of instruction. 

FUNDING: Funding and staffing of the above projects should be the 
responsibility of those who see them as justifiable on a business basis. Projects 
which relate to the computer industry should be staffed and funded by 
companies involved. Educational participation will probably only be justified 
by larger school institutions, educational research centers and universities. 
Leadership and coordination should be provided by the US Office of 
Education. Where joint studies between companies and educational institu- 
tions are warranted, they should be encouraged. But in such joint studies, each 
participant should fund his own expenses. Special subsidies will only serve to 
produce unrealistic results from a business viewpoint. 

TARGET POPULATION: While the broad spectrum of all students is included 
in the target population here, this can be narrowed to only elementary schools 
if desired. It is my belief that if the CA1 problem can be solved for elementary 
schools (particularly from the standpoint of cost) the solution is easily 
adaptable to the rest of education. 

TIME PROJECTION: The projects outlined above will typically require one to 
two years to reach conclusion. The modifications to CAl should be planned to 
meet the cost constraints expected in education in the 1975-80 timeframe. 

53. (83) Very necessary for w'ork in elementary schools are inexpensive, versatile 
consoles (student stations). An intensive effort should be undertaken to design a 
commercially feasible random access to audio and visual displays. In elementary 
schools, the storage capacity need not be very great; but inexpensive access to a 
limited set of displays would be highly desirable.' 

FUNDING: Industry — $75,000 a year for three years. 

TARGET POPULATION: Elementary schools. 

TIME PROJECTION: Three years. 
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Appendix 5 

Action Statements 



Following are the 83 action statements compiled for the conference from the 
questionnaire data, plus the additional statements which were suggested and included 
for consideration during the conference. 

1. Large-scale Demo 

Mount a large-scale experiment to demonstrate the economic feasibility of CAI. 

2. Mobile Demo 

Institute a mobile demonstration that could travel from school to school, carrying 
terminals, plotters, minicomputers, and data acquisition equipment, and provide 
thorough and realistic demonstrations of how teachers use computers in their 
courses. 

3. Labs as Showcases 

Use existing facilities and labs not only to implement CAI ideas but also as showcases 
for demonstrating successful CAI techniques. 

4. Demo — Non-educational Sector 

Demonstrate the efficacy of a large-scale CAI system in the military, governmental, 
or private sector to ease its acceptance into the educational community. 

5. Cooperative Project 

Implement a cooperative project involving a community college system and a major 
commercial producer of educational materials to develop, test, and demonstrate a 
remedial course in English, 

6. Adjunct Systems 

Concentrate on development of adjunct CAI systems in limited areas of concern, e.g,, 
science laboratory work, rather than main-line general systems. 

7. Reading — Elementary School 

Organize a national effort to create two or three alternative CAI programs aimed at 
the correction of reading deficiencies in elementary school children. 

8. Reading — Young Adults 

Implement a reading improvement program for young adults that could be run as a 
remedial, open -enrollment city university program. 




9. Remedial Math 



Develop a computer-managed system of instruction in remedial mathematics for 
grades 7*12. 

10. Disadvantaged 

Focus a CAI program on reducing inequities in the education of disadvantaged 
children. 

11. Rapid and Slow Learners 

Develop special CAI programs for both rapid and slow learners at all levels. 

12. The Deaf 

Develop courseware for teaching the deaf to read and write. 

13. High School Opportunities 

Provide opportunities for high school students to work with computers in their own 
instruction through participation in the production of hardware and the development 
of curriculum materials. 

14. JobCorpsmen 

Develop an experimental program to prepare talented job corpsmen in the 
fundamentals of computer technology. 

15. Para-professional 

Organize a national effort to create a computer-assisted course in a selected 
para-professional subject (e.g., X-ray techniques, police management, assistance 
programs for the aged). 

16. Unemployed 

Subsidize industry to develop CAI packages for retraining unemployed workers. 

17. Group Instruction 

Experiment with the application of CAI to group instruction in addition to individual 
instruction. 

18. Classroom Games 

Develop computer-based games to provide structured interaction between different 
classrooms in the same, or different, schools. 

59. Simulation and Gaming 

Concentrate curriculum development efforts on utilization of the computer's unique 
capabilities, e.g., in problem-solving exercises, simulation, and gaming. 

20. Cooperative/Competitive 

Develop programs in which the student questions the computer rather than the 
(cooperative rather than competitive use of the computer in a learning 

iriuduun). 

21. Learning Styles 

Develop the capability to identify and match student learning styles in different 
content areas with appropriate pedagogical techniques. 
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22. Learner Control 



Develop systems that allow more learner control of the material and of the style of 
teaching. 

23. CAI Learning Models 

Develop a model of the learning process that provides insight into the uses of CAI 
(rather than a general-purpose model). 

24. Learning Theories 

Develop a foundation of theories of learning and experimental data which would 
enable the computer to be maximally flexible and effective in teaching, as opposed to 
being a page-turning and response-recording device. 

25. CAI Modules 

Develop methodologies and techniques to support organization of course material 
into modules that can be utilized in CAI systems. 

26. Special Ed. Problems 

Develop courseware to train teachers to identify special education problems and to 
prescribe appropriate remediation. 

27. Support Teachers in CAI Development 

Identify teachers who are good writers and who have classroom experience in 
computer applications and support them in the writing, publishing, and distribution 
of quality curricular materials. 

28. Finance Teaching of CAI Techniques 

Finance teacher training institutions to include practical training in the use of 
hardware and software, and in the techniques of integrating CAI with the traditional 
education process. 

29. Summer Workshops 

Institute summer workshops to provide teachers with hands-on experience with 
available CAI systems. 

30. Incentives for Teacher-Training 

Offer financial incentives for teachers to take training courses in the use of CAI. 

31. Training in Technology 

Develop through NIE an agency to train teachers in instructional technology, 
including capabilities and limitations of processing systems and design, development, 
installation, and evaluation of self-instructional materials. 

32. Individually Prescribed Instruction 

Provide courses in individually prescribed instruction and small-group tutoring in 
schools of education, thereby providing teachers with a background more appropriate 
to CAI. 

33. Instructional and Management Support 

Design a computer-based system which would provide support for all of the 
instructional and management functions in a school system. 
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34. Train Administrators 

Implement a program of systematic dissemination and training in CAI applications 
for school administrators, 

35. Model for Administrators 

Develop a computer-based, interactive model for school administrators that shows 
how schools can incorporate CAI. at what cost, and at what savings. 

36. Model Elementary School 

Set up one or more CAI -based model elementary schools. 

37. Model High School 

Set up one or more C A. t -based model high schools. 

38. McdH Co!>>ge 

Set one or r'iore CAI -based college campuses. 

39. Mcdul Town 

Set a large-scale model demonstration of CAI-in-the-home in a new town (200 
ov/i towns are now in some stage of planning or construction in the U.S.l 

40. 3%mmer/Evening Instruction 

Exploit the opportunity for individualized instruction during summer and evening 
hours. 

41. Cost-Sharing 

Develop cost-sharing programs for school districts and learning centers installing 
computer-based instructional programs. 

42. Budgeting Cycle 

Revise year-to-year budgeting for operating expenses so that school systems can be 
better prepared to finance substantial capital investments. 

43. Lock-Step 

Produce and test alternatives to lock-step procedures to accommodate differences in 
learning speed and in curriculum selection. 

44. Community Coordinators 

Establish model community agencies for coordinating CAI applications in urban 
school systems. 

45. Private Investment 

Permit private investment to provide the capital for schools interested in imple- 
menting CAI systems. 

46. Private Development 

Implement a liberal policy of support for private equipment and software 
development organizations. 

47. Tax Incentives 

Provide tax incentives for industrial investment in CAI 
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48. Regional Centers 

Establish regional centers with local and visiting faculty to develop materials and to 
use and revise them in classroom applications. 

49. Joint Laboratories 

Set up CAI laboratories for authors and supporting technical teams, to be run jointly 
by teacher training institutions and textbook publishers. 

50. Discipline-Oriented Centers 

Establish a number of discipline-oriented centers for production of course materials 
that support the use of computing within the curriculum. 

51. Discipline Task Forces 

Develop discipline or educational level task forces to develop a CAI prototype in a 
particular field and to demonstrate the quality and feasibility of the endeavor. 

52. Discipline-Based Standards 

Fund committees and review panels within disciplines to encourage the establishment 
and application of discipline-based standards. 

53. National Clearinghouse 

Establish a national clearinghouse for the collection and distribution of CAI 
materials. 

54. Research Institutes 

Set up research institutes and quality training programs to attract people of high 
intellectual calibre to CAI field. 

55. Graduate Programs in Teaching 

Establish graduate programs oriented toward teaching rather than research, as a first 
step toward quality education, including CAI development. 

56. Professional Incentives 

Establish professional incentives for university faculty through a grant program that 
requires from the recipient university assurance that work pn CAI development 
would be judged equivalent to research, in terms of promotion, salary, etc. 

57. Exchange of Professionals 

Introduce a system of exchanges of CAI professionals among industry, government, 
schools and universities. 

58. Professional Journal 

Publish a first-rate professional journal solely for the instructional uses of computers. 

59. Annual Award 

Offer annual national awards for the best CAI programs. 

60. Copyrights 

Develop copyright procedures to protect CAI products. 

61. Royalty Payments 
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Arrange for royalty payments and credit to individual authors for CAI curriculum 
development. 

62. Publisher Fees 

Create "market" for CAI materials by providing mechanisms and incentives (e.g. f 
publisher fees) for program production, distribution, and use. 

63. Hardware Standards 

Develop national standards for equipment to insure interchangeability of curriculum 
packages. 

64. Software Format 

Establish a format for the production of software that will make it usable in a variety 
of hardware systems. 

65. CAI Languages 

Improve the efficiency of writing CAI programs by the development of better CAI 
languages. 

66. Instructional Designers 

Train instructional designers to supplement the work of CAI authors and production 
personnel. 

67. Continuing Evaluation 

Develop a continuing program for evaluation of CAI programs, techniques, curricula, 
administration, and organization. 

68. Evaluation Systems 

Set up a comprehensive research program to test a variety of CAI-based evaluation 
systems at school and college levels, possibly including performance in simulation 
exercises and educational games as a rating device. 

69. Cost-Evaluation Studies 

Conduct detailed evaluation studies that provide the data needed by school 
administrators to justify the introduction of new capital-intensive equipment and 
techniques. 

70. "Benchmarks" 

Identify the full range of CAI system requirements and develop "benchmarks" to 
measure progress and to assess effective management. 

71. CAI Barriers 

Institute a comprehensive research program to identify barriers to the introduction of 
CAI and to determine the changes which might contribute to their removal. 

72. CPU Cost 

Reduce the cost of central processor time to the neighborhood of 20 cents per 
student/contact hour. 

73. Hardware Development Costs 

Concentrate on reducing basic hardware 8nd software development costs so that CAI, 
as a consequence, can become cost-justified. 

128 



130 



74. Hardware Interface 



Support research to identify the relative importance of keyboards, C.R.T. displays, 
accessory audio-visual devices, etc. 

75. Computer Design 

Design computer logic and architecture appropriate to the primarily non-numeric 
processing demands of CAI. 

s* - 76. Semantic Analysis 

Develop software to perform semantic analysis for processing student inputs 
expressed in natural language. 

77. Integrate Media 

Design a CAI system that integrates a number of instructional modes and media. 

78. Educational Terminal 

Organize a team of industrial designers, engineers, teachers, and students to develop 
one or several educationally oriented computer terminals. 

79. Communications Equipment 

Utilize existing communications equipment, e.g., television, telephone, electric 
typewriters, to produce cost breakthroughs in CAI. 

80. Cable TV 

Combine large time-sharing computers and cable TV with appropriate terminals to 
produce lower costs. 

81. Graphics Capability 

Develop student terminals that offer a graphics capability. 

82. Videotape Cassettes 

Develop a computer terminal which can utilize videotape cassettes. 

83. Audio Unit 

Develop a computer-controlled random access audio unit for use in teaching reading 
and languages. 

Additional action statements resulting from the conference discussion: 

84. The Blind 

Develop courseware for the blind. 8raille terminals exist and Braille also can be 
produced by a terminal. 

85. Investigator-Reporter 

Fund a single, highly competent investigator-reporter to survey the whole field and 
report on its present state and prospects in the clarifying, framesetting way done, 
e.g., by Jean Chall in The Teaching of Reading. 

86. Health Sciences 

Develop a national center for the health sciences. 
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87. Programming Courses 

Teach programming (Fortran?) as part of the core curriculum. 

88. Feedback From Schools 

Obtain feedback from school personnel on the factors which impede the implementa- 
tion of CAI in the schools. (Include teachers, administrators, school board members, 
and various “minorities”.) 

89. Non-Science Majors 

Teach a course on computers for nomscience majors. 

90. “Sesame St." 

Fund “Sesame St." type curriculum development projects for CATV distributed CAl. 
Effective, efficient, and palatable instruction. 
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